does anybody know how to turn a dreambooth model into an inpaint model?
does anybody know how to turn a dreambooth model into an inpaint model?
Aa atempted to use merge checkpoint and use an inpaint model with the dreambooth model and then put vanilla 1.5 as C and do add difference, but it completly messes up the dreambooth model and makes the trained subject barley useable..
Fi think it should be
Fdon't know :/ have you asked on reddit?
Rhey, i dont go on reddit much. what channel on reddit should i go to?
RBy the way, did you know you can use Stable Tuner's api to monitor epoch training via Telegram? Its pretty cool
Fmain stable diffusion
ROh right, cool will check
Rso you can live updates every time the training spits out samples for each epoch
Fdo you want me to test any prompts with DeepFloyd-IF
Fdmn their naming so stupid
Rtry something like "photo of fashion model walking in the street in london in the style of i-D magazine 2000's by mario testino, masterpiece, film camera
Dhello, would you guys know what could cause kohya lora training not to work?
Dcouldn't fine anything online
Ayea,, there is this guide: https://www.reddit.com/r/StableDiffusion/comments/zyi24j/how_to_turn_any_model_into_an_inpainting_model/
but the problem is that it doesn't take dreambooth in to account.. I'm sure it works on ordinary models but for dreambooth it seems to completly mess up the trained part of the dreambooth model, almost as if it's too much of a specific part of the model, where ordinary models have a more general training data..
but the problem is that it doesn't take dreambooth in to account.. I'm sure it works on ordinary models but for dreambooth it seems to completly mess up the trained part of the dreambooth model, almost as if it's too much of a specific part of the model, where ordinary models have a more general training data..
reddit
322 votes and 93 comments so far on Reddit
Adid you train a locon ? or ordinary lora?
Djust Lora I don't even know what locon is
and it didn't even strat training
and it didn't even strat training
Dit just gives out some vague error
Athis is the problem.. what model are you trying to train on ?
Fon which model you are doing training?
Drealistic vision 1.3 I think it was but I tried the normal SD 1.5 and same thing happened I don't think the model is the problem
Fcan you try without mem eff attention
Falthough it indicates model structure error
Fi suggest to first try with some of the base models
Dokay I will right now
Fremove gradient checkpoint and memory attention and try again please
Dokay that seem to have done it
Dgradient and memory attention
Dthank you
Fyou are welcome
Dsorry I didn't reply had to do something
Ano worries.. @Furkan Gözükara SECourses said it well 
Ii get this message when the kohya ss lora starts
"Replace CrossAttention.forward to use xformers"
"Replace CrossAttention.forward to use xformers"
Idoes xformers speed it up, is mine not using it?
A@Furkan Gözükara SECourses do you have any suggestions for prompts/method for inpainting face correction?
Axformers uses less vram
Ahave you checked the xformers box?
Iyea, but then i get that message so im not sure its working
Iwell its only using 10.8GB of 24 VRAM so not a big deal i guess, but if it speeds up training then id like it
Awith 24 I don't think you should use xformers.. I think it gives worse results.. mind you I only have 12 so I have never tryed myself..
Iive heard this a few times now
Ii wont worry then
Fhow much it you are getting with what batch size
Fi use original prompt. if you also upscale image with img2img and low denoise it helps significantly to fix faces
Fyou can increase batch size the significantly increase training speed
Fhowever it changes how the model trained
Fit is a machine learning topic
Alike you did in your last video? going to give that a try now..
Ado you upscale before inpaint? or is upscale usually enough ?