Okay thanks a lot! Lastly, I'm curious if it would be appropriate to use a dynamic optimizer in this
Okay thanks a lot! Lastly, I'm curious if it would be appropriate to use a dynamic optimizer in this case as well. I've consistently used the Prodigy optimizer and cosine LR scheduler with LoRA, and I'm wondering if they would be effective when training with a large number of images.
Of course, frequent experimentation should be prioritized, but it would be greatly helpful if there's any guidance on where to set the starting point. Thank you!
Of course, frequent experimentation should be prioritized, but it would be greatly helpful if there's any guidance on where to set the starting point. Thank you!