Changed the settings when making the model. Not sure its that much better. Its so hard to tell. The first one I didn't use blip and 700 steps with Gradient accumulation steps set to 3 and batch size of 4, learning rate .004. This one everything is set to default and I used blip trained to 3400 steps. Used the inspect script to make sure it wasn't overly trained.
Changed the settings when making the model. Not sure its that much better. Its so hard to tell. The first one I didn't use blip and 700 steps with Gradient accumulation steps set to 3 and batch size of 4, learning rate .004. This one everything is set to default and I used blip trained to 3400 steps. Used the inspect script to make sure it wasn't overly trained.