@Dr. Furkan Gözükara which of your Flux Lora training configs is a good balanece of speed with true
@Dr. Furkan Gözükara which of your Flux Lora training configs is a good balanece of speed with true photo realism?
Bim trying to get the trainer on fal.ai to get as good results in terms of detail and realism as your kohya configs. the fast trainer doesn't do it very well so im using the regular trainer.
Fboth fast and good on 24 gb gpus
BThank you
Dusing embeddings or TE training might solve that issue though. Not bad on the left with embedding, on the right just "woman" with no bleeding.
FTE training doesnt solve
Ehey @Dr. Furkan Gözükara quick question. Can Flux 1.1 be Lora trained or even downloaded? As far as I see it can only be used in platforms at the moment.
Factually i trained single layer
Fit didnt solve too :d
Fnope they didnt publish any model
Dno it doesn't. it might solve MY problem that the "instance" is harder to train using regularization. it doens't solve yours. I don't know what's going on with yours. wanna share config+pics?
Fyes my config same as on patreon nothing different 
same as kohya one
same as kohya oneFmy dataset here
EI didnt' think so either, but then I just came across this? Looks like pro 1.1 is available?
https://civitai.com/models/618692?modelVersionId=922358
https://civitai.com/models/618692?modelVersionId=922358
Dsince we are looking for a specific problem I'd prefer to have original data. config file + image files. DM
Fi think only inference via api
Fsure sending dm
Bwhats the minium steps needed you think for training 40 images, for true photorealism?
Flets say 100 epoch for good resemblance
F4000 steps batch size 1
Bgreat thanks
Fi will update batch size 1 fine tuning configs
Ffor latest kohya
Bwhen training lora did you notice much difference between adafactor and adamw8bit?
Fi plan to investigate
Fnewest optimizers hopefully soon
Fbut each one would require different parameters
Fhahaha 4765 MB can do flux fine tuning now :d
Cexcept it cant. you know what dpo is?
Fit is i am doing right now. for single concept it will work perfect
Cyou can't fine tune, or train, flux. you are just creating something that gives you an image but you're not updating the weights or training the model, Doctor
Fif i am not updating weights of the model it must be magic then
Ci'll ask you again, do you know what DPO is
Ftell me full words of it
Ddid you try man or woman
Cthe paper's on arXIv - i suggest you read it
Dthat's hilarious statement.
Dif you know so much about how Flux dev was created, please tell us how exactly the distillation from pro to dev was done, and how DPO was applied (which I'm not doubting - why wouldn't they)
EOK. Just asking cuz I have a 4090 & I've seen upwards of 60GB of system RAM usage when not rendering, when I start a render it goes down (I'm guessing that's loaded on to the gpu).
Cyou don't apply dpo to a base model - not if you're smart
Dtell us why. DPO is proposed as an alternative to RLHF which obviously was applied very successfully for LLMs
Ffine tuning configs for 6 gb, 8gb, 10 gb , 12 gb , 16gb and 24 gb
F
CI'll let you go read the paper and think
Dso you don't know the answer. alright.
Ci do, but i don't feel like hand-feeding you. and you trying to manipulate me into handing you the research you don't want to do isn't going to work
Dyou are making unsubstantiated claims that you know more about how Flux was created than the general public. anyone can read papers. you have to substantiate your claim.
Ci owe you nothing. i direct you, if you want a place to start your research other than arXiv, to all the posts on this discord ALONE where people talk about how many times they've tried to train flux for something and how it doesn't work. even Furkan himself has expressed issues with that. and that is all i'm giving you for free. go do the research
Cbe just as snarky as you like now, i'm done with you
Dblocked