I just got some pretty good results with this data and these settings:
42 training images of myself in different situations/lighting
caption .txt files that go along with the images
RealisticVisionV20 as a source checkpoint
Saving
-Use Lora
-use Lora extended
-100 steps/epochs
-batch size 2
-use gradient checkpointing
-0.00001 unet learning rate
-constant_with_warmup LR scheduler
-other settings from all the vids, 8bit AdamW, fp16, xformers
-Scale prior loss (checked, did not edit values)
-no sanity prompt
Concepts
-Used directory with photos of me, and .txt files with the token I assigned replacing my name
-no class data
-instance token is my name without vowels
-class token is man
-instance and class prompts are [filewords]
-sample prompt boxes are blank
-no class img gen
I'd rate the results i'm getting 7 or 8 out of 10, any tips appreciated
