Increased training steps.
Increased training batch size (28)
Switched to dyLora with prodigy optimizer
I trained for 40 epochs, but it became significantly overfit after 30 epochs.
Increased training steps.
Increased training batch size (28)
Switched to dyLora with prodigy optimizer
I trained for 40 epochs, but it became significantly overfit after 30 epochs.