Software Engineering Courses (SECourses)•3y ago

Hi, I'm trying to train a LORA model in Dreambooth on Automatic1111. I got it to kind of work a few

Hi, I'm trying to train a LORA model in Dreambooth on Automatic1111. I got it to kind of work a few times but now I can't seem to get good results. It seems like using a class data set along with my images makes the result worse. If I share my parameters/data info could someone give me some tips on what to change?

rafraf•4/29/23, 6:39 PM

does anyone know how to update the Lora models in Auto1111 when you click refresh. I actually have to quite the terminal and relaunch from scratch. Refresh Lora tab and reload webui, neither refresh the new model in. Any thoughts?

AAstuary Hi, I'm trying to train a LORA model in Dreambooth on Automatic1111. I got it t...

Furkan Gözükara SECourses•4/29/23, 7:26 PM

hi welcome. i am waiting sd web ui update to make a new lora video but sure you can share settings

Rrafraf does anyone know how to update the Lora models in Auto1111 when you click refres...

Furkan Gözükara SECourses•4/29/23, 7:27 PM

it dont see models?

FFurkan Gözükara SECourses hi welcome. i am waiting sd web ui update to make a new lora video but sure you ...

AstuaryOP•4/29/23, 8:53 PM

I just got some pretty good results with this data and these settings:

42 training images of myself in different situations/lighting
caption .txt files that go along with the images
RealisticVisionV20 as a source checkpoint

Saving
-Use Lora
-use Lora extended
-100 steps/epochs
-batch size 2
-use gradient checkpointing
-0.00001 unet learning rate
-constant_with_warmup LR scheduler
-other settings from all the vids, 8bit AdamW, fp16, xformers
-Scale prior loss (checked, did not edit values)
-no sanity prompt

Concepts
-Used directory with photos of me, and .txt files with the token I assigned replacing my name
-no class data
-instance token is my name without vowels
-class token is man
-instance and class prompts are [filewords]
-sample prompt boxes are blank
-no class img gen

I'd rate the results i'm getting 7 or 8 out of 10, any tips appreciated

AAstuary I just got some pretty good results with this data and these settings: 42 train...

Furkan Gözükara SECourses•4/29/23, 8:54 PM

nice thanks for letting us know

Furkan Gözükara SECourses•4/29/23, 8:54 PM

have you compared with kohya lora?

FFurkan Gözükara SECourses have you compared with kohya lora?

AstuaryOP•4/29/23, 8:55 PM

I haven't

AstuaryOP•4/29/23, 8:56 PM

is it a lot of work to setup? Figuring out SD and Automatic1111 and Dreambooth has been a lot lol

AAstuary is it a lot of work to setup? Figuring out SD and Automatic1111 and Dreambooth h...

Furkan Gözükara SECourses•4/29/23, 8:57 PM

agreed

Furkan Gözükara SECourses•4/29/23, 8:57 PM

recording a video for DeepFloyd-IF

FFurkan Gözükara SECourses recording a video for DeepFloyd-IF

AstuaryOP•4/29/23, 8:57 PM

your videos have helped me a lot already, looking forward to your future uploads!

AAstuary your videos have helped me a lot already, looking forward to your future uploads...

Furkan Gözükara SECourses•4/29/23, 8:59 PM

thank you so much

rafraf•4/29/23, 9:02 PM

Hi @Furkan Gözükara SECourses got a question. Trying to update StableTuner to Torch2.0. I am looking at your tut. Yours is venv/Scripts/activate... But i installed virtual environment with miniconda3. So would i do the same in envs/ST/Scripts/activate (ST is the name of the environment).. everything else the same?

rafraf•4/29/23, 9:02 PM

pip install --force-reinstall torch torchvision --index-url https://download.pytorch.org/whl/cu118
pip install --force-reinstall --no-deps --pre xformers

AlexGilSeg•4/29/23, 9:03 PM

does anybody know how to turn a dreambooth model into an inpaint model?

AlexGilSeg•4/29/23, 9:04 PM

a atempted to use merge checkpoint and use an inpaint model with the dreambooth model and then put vanilla 1.5 as C and do add difference, but it completly messes up the dreambooth model and makes the trained subject barley useable..

Rrafraf Hi @Furkan Gözükara SECourses got a question. Trying to update StableTuner to To...

Furkan Gözükara SECourses•4/29/23, 9:10 PM

i think it should be

AAlexGilSeg does anybody know how to turn a dreambooth model into an inpaint model?

Furkan Gözükara SECourses•4/29/23, 9:11 PM

don't know :/ have you asked on reddit?

rafraf•4/29/23, 9:11 PM

hey, i dont go on reddit much. what channel on reddit should i go to?

rafraf•4/29/23, 9:12 PM

By the way, did you know you can use Stable Tuner's api to monitor epoch training via Telegram? Its pretty cool

Rrafraf hey, i dont go on reddit much. what channel on reddit should i go to?

Furkan Gözükara SECourses•4/29/23, 9:12 PM

main stable diffusion

Rrafraf By the way, did you know you can use Stable Tuner's api to monitor epoch trainin...

Furkan Gözükara SECourses•4/29/23, 9:12 PM

wow nice

FFurkan Gözükara SECourses main stable diffusion

rafraf•4/29/23, 9:12 PM

Oh right, cool will check

FFurkan Gözükara SECourses wow nice

rafraf•4/29/23, 9:13 PM

so you can live updates every time the training spits out samples for each epoch

Rrafraf so you can live updates every time the training spits out samples for each epoch

Furkan Gözükara SECourses•4/29/23, 9:14 PM

nice

Furkan Gözükara SECourses•4/29/23, 9:14 PM

do you want me to test any prompts with DeepFloyd-IF

Furkan Gözükara SECourses•4/29/23, 9:14 PM

dmn their naming so stupid

rafraf•4/29/23, 9:17 PM

try something like "photo of fashion model walking in the street in london in the style of i-D magazine 2000's by mario testino, masterpiece, film camera

Daniel•4/29/23, 9:33 PM

hello, would you guys know what could cause kohya lora training not to work?

Daniel•4/29/23, 9:34 PM

couldn't fine anything online

FFurkan Gözükara SECourses don't know :/ have you asked on reddit?

AlexGilSeg•4/29/23, 9:41 PM

yea,, there is this guide: https://www.reddit.com/r/StableDiffusion/comments/zyi24j/how_to_turn_any_model_into_an_inpainting_model/

but the problem is that it doesn't take dreambooth in to account.. I'm sure it works on ordinary models but for dreambooth it seems to completly mess up the trained part of the dreambooth model, almost as if it's too much of a specific part of the model, where ordinary models have a more general training data..

r/StableDiffusion - How to turn any model into an inpainting model

322 votes and 93 comments so far on Reddit