it seems to be --disable-cuda-malloc related
it seems to be --disable-cuda-malloc related
Dfrom what im reading,
Dif im getting it right, but im unsure where to insert that
Dlooks like it goes into the .bat
Lso I need to extract a lora that i like? and then to do a dreambooth training on it?
Dsay you want to make the best quality lora, you would do a fine tune, then there is a function in kohya that looks at the base file(flux) and your fine tune safetensor and it extracts the difference between them. That becomes your final lora
LFine tune is to train a dreambooth?
LSorry I'm just started learning
Dyes
LWhen I train dreambooth I need to train big data set of man pics again with also my pics?
Dfor flux?
LYes
LBecause I remember that what you needed for sdxl
Dno man pics. reg images don't work with flux
LOh cool
LSo Im taking my lora and my dreambooth and doing extraction
LAnd it will do the best result
Cyou only need to do one or the other
CYou can train a lora directly, or you can do a finetune and extract a lora which will be better quality
LOh
LOk thank you
LThank you both
CNo problem. Are you training locally or on massed compute or something?
LThere will be support for 1.1?
C1.1 is flux pro. flux pro, all versions, are api only
CI personally doubt it, I don't see the reason for them releasing it
LI'm doing local with 4090
Ci'm going to suggest you go to the technical support channel on the stable diffusion discord and look for CS1o, and ask him about that. that question comes up in there all the time
Dthank you\
LMaybe there is better checkpoints instead of training flux? Like people not fine tune the model to do more realistic? Like sdxl models
CIf you are doing the fine tune just be aware when it saves checkpoints they are huge, if you are wanting to just tinker around for fun I think a lora is a decent first option. Just get like 15 pics that are half decent and see how it goes
LI already did lora and it did very well
CIf you are wanting a better checkpoint for the people realism (eg skin) part I think you will likely find that your own training/lora will already address that enough as is probably
LHmm it interesting
CDepends what your goal is of course. Personally I have just trained of dev and have been very happy with the results as far as skin texture etc but im just messing around for fun with friends family so not super picky. The only time I trained something other than dev was when I trained a lora of our old dog using the checkpoint i trained of my wife as using two loras was giving me junk results
LWell I trained on my pics and lot of the pictures doing smooth skins i wondered if it because of of my data set maybe some of the pics has smooth skin filter
LI trained on 33 pics
Cthe AI is only going to learn what it's taught ...
Cit's a computer, it's not about to guess
IYo
ISo can we fine tune the whole model now?
Cno
IOh then I don't get what furkan posted this weekend xD
LLet's do our own research and create better model!
Ccool - you'll need a high powered data center, a couple million dollars, and a staff of research scientsts.
Lsounds easy
IMoney 
Cif it was easy, everyone and their dog would be putting out killer models
Bhey @Dr. Furkan Gözükara Are there any additional benefits to using the DreamBooth/extract method for fine-tuning Flux compared to directly training a LoRA, besides achieving higher image quality? For example, does it offer better resistance to overfitting, more flexibility, or differences in training time?
Byup, making your own models requires tons of capital for the staff and compute required to pull it off. It's why there only a few startups out there with their own models and lots of AI companies using API
Cjust putting the data set together, correctly, for a base model, is quite a task that requires expertise - never mind training the thing