Maybe torch 2.5.0 could help shorten the time 😛
Maybe torch 2.5.0 could help shorten the time 
NGood luck sir
Aany one has past experience in uploading custom lora to hugging face ?
Aneeded a bit help
DI made a comparison between ai-toolkit vs kohya lora training. For all the same parameters except for rank(kohya:128/128, ai-toolkit:64/64), kohya lora gives much better likeness and overall image quality. Does anyone have any observation on this or have a comment why kohya lora outperforms?
KKohya-installation according to @Dr. Furkan Gözükara = ?
KYepp... Same with Torch 2.5.0
KSo many errors... Soooo many errors 
KI hate torch and "generating weels"
KStill... Seem to be faster than 2.4.0
DDr. Gozukara, have you got any experiments on greater learning rates than 5e5 with fewer iterations? What have been your observations?
�It will outperform you are using a higher rank in kohya so it will learn more
�On how many images are you training? are you using captions? what learning rate? what network dim and alpha?
�@Dr. Furkan Gözükara How are you mentioning what blocks to train in kohya gui? I tried this but got an error -
Fyes weight 1.1 most close
Fi will post an article
Fi am aobut to post an article grid
Fdifferent workflows
Fkohya is more professionals has more experience 
Flooks like xformers requires new cuda
Fi will just remove it
Fremoved it
FPatreon
Get more from SECourses: Tutorials, Guides, Resources, Training, FLUX, MidJourney, Voice Clone, TTS, ChatGPT, GPT, LLM, Scripts by Furkan Gözü on Patreon
Fyes 2.5 really faster but not as fast as linux :/
Fit will work good on things that are not as delicate as human face
Flike styles
Fcars
Fthis is correct
Fre update your kohya
�How? I am using your installers for runpod
Freinstall
�Okay thanks
Fsingle layer quality is bad
�Okay I will test others as well. Is it possible to train multiple subjects in a checkpoint fine tune without bleeding?
Fstill bleeds
Fbut each concept can be trained on each different layer
Fprogressively
�Will try that
Fbut the quality is lower
Flol even single layer bleeds
Fdoesnt make sense
Dwhat do you mean by bleeding?
Fcharacters get mixed
For concepts
M@Dr. Furkan Gözükara yes its because flux is distilled
Myou cant fix the bleeding issue, even with lokr you still get bleed
Fi trained only single layer
FFsingle layer 10 specifically
Mflux is cooked, sd3 8b coming out soon hehe
Fi guess single layer training has no value except companies to give you cheap results
