Dr. Gozukara, have you got any experiments on greater learning rates than 5e5 with fewer iterations?
Dr. Gozukara, have you got any experiments on greater learning rates than 5e5 with fewer iterations? What have been your observations?
�It will outperform you are using a higher rank in kohya so it will learn more
�On how many images are you training? are you using captions? what learning rate? what network dim and alpha?
�@Dr. Furkan Gözükara How are you mentioning what blocks to train in kohya gui? I tried this but got an error -
Fyes weight 1.1 most close
Fi will post an article
Fi am aobut to post an article grid
Fdifferent workflows
Fkohya is more professionals has more experience 
Flooks like xformers requires new cuda
Fi will just remove it
Fremoved it
FPatreon
Get more from SECourses: Tutorials, Guides, Resources, Training, FLUX, MidJourney, Voice Clone, TTS, ChatGPT, GPT, LLM, Scripts by Furkan Gözü on Patreon
Fyes 2.5 really faster but not as fast as linux :/
Fit will work good on things that are not as delicate as human face
Flike styles
Fcars
Fthis is correct
Fre update your kohya
�How? I am using your installers for runpod
Freinstall
�Okay thanks
Fsingle layer quality is bad
�Okay I will test others as well. Is it possible to train multiple subjects in a checkpoint fine tune without bleeding?
Fstill bleeds
Fbut each concept can be trained on each different layer
Fprogressively
�Will try that
Fbut the quality is lower
Flol even single layer bleeds
Fdoesnt make sense
Dwhat do you mean by bleeding?
Fcharacters get mixed
For concepts
M@Dr. Furkan Gözükara yes its because flux is distilled
Myou cant fix the bleeding issue, even with lokr you still get bleed
Fi trained only single layer
FFsingle layer 10 specifically
Mflux is cooked, sd3 8b coming out soon hehe
Fi guess single layer training has no value except companies to give you cheap results
Msingle layer quality is bad
Mnot worth it
Fyep
Mi think there is an issue with using the new torch versions @Dr. Furkan Gözükara quality seems to change and training as well
Fwhich one?
Mthe new dev ones
Fi plan to test it actually
Fsince multi gpu for fine tune fails :/
Feven on 48 gb
Fcurrently i locked windows to 2.5 RC
