Software Engineering Courses (SECourses)•16mo ago

I made a comparison between ai-toolkit vs kohya lora training. For all the same parameters except fo

I made a comparison between ai-toolkit vs kohya lora training. For all the same parameters except for rank(kohya:128/128, ai-toolkit:64/64), kohya lora gives much better likeness and overall image quality. Does anyone have any observation on this or have a comment why kohya lora outperforms?

Kallamamran•9/18/24, 8:32 AM

Kohya-installation according to @Dr. Furkan Gözükara = ?

Kallamamran•9/18/24, 8:42 AM

Yepp... Same with Torch 2.5.0

Kallamamran•9/18/24, 8:45 AM

So many errors... Soooo many errors

Kallamamran•9/18/24, 8:46 AM

I hate torch and "generating weels"

Kallamamran•9/18/24, 8:57 AM

Still... Seem to be faster than 2.4.0

di_en_eyOP•9/18/24, 10:24 AM

Dr. Gozukara, have you got any experiments on greater learning rates than 5e5 with fewer iterations? What have been your observations?

Ddi_en_ey I made a comparison between ai-toolkit vs kohya lora training. For all the same ...

�

𝗡𝗶𝘁𝗶𝗻 𝗣𝗮𝗿𝗲𝘃𝗮•9/18/24, 10:26 AM

It will outperform you are using a higher rank in kohya so it will learn more

KKallamamran WTF?! Trained a LORA on the "The Next Day" concept car from Lynk&Co yesterweek. ...

�

𝗡𝗶𝘁𝗶𝗻 𝗣𝗮𝗿𝗲𝘃𝗮•9/18/24, 10:30 AM

On how many images are you training? are you using captions? what learning rate? what network dim and alpha?

�

𝗡𝗶𝘁𝗶𝗻 𝗣𝗮𝗿𝗲𝘃𝗮•9/18/24, 10:32 AM

@Dr. Furkan Gözükara How are you mentioning what blocks to train in kohya gui? I tried this but got an error -

MMaxivi are you using with weight 1.1?

Furkan Gözükara SECourses•9/18/24, 10:34 AM

yes weight 1.1 most close

Furkan Gözükara SECourses•9/18/24, 10:34 AM

i will post an article

Ssmoke Would be strange though since all the other lora showcases it looked pretty much...

Furkan Gözükara SECourses•9/18/24, 10:35 AM

i am aobut to post an article grid

KKallamamran LR UNET was set according to @Dr. Furkan Gözükara config file (4e-6 = 0,000004),...

Furkan Gözükara SECourses•9/18/24, 10:35 AM

different workflows

Ddi_en_ey I made a comparison between ai-toolkit vs kohya lora training. For all the same ...

Furkan Gözükara SECourses•9/18/24, 10:37 AM

kohya is more professionals has more experience

KKallamamran Kohya-installation according to @Dr. Furkan Gözükara = ?

Furkan Gözükara SECourses•9/18/24, 10:37 AM

looks like xformers requires new cuda

Furkan Gözükara SECourses•9/18/24, 10:37 AM

i will just remove it

Furkan Gözükara SECourses•9/18/24, 10:40 AM

removed it

Furkan Gözükara SECourses•9/18/24, 10:40 AM

https://www.patreon.com/posts/110879657

Patreon

Kohya FLUX LoRA Training Full Tutorial For Local Windows and Cloud ...

Get more from SECourses: Tutorials, Guides, Resources, Training, FLUX, MidJourney, Voice Clone, TTS, ChatGPT, GPT, LLM, Scripts by Furkan Gözü on Patreon

KKallamamran Still... Seem to be faster than 2.4.0

Furkan Gözükara SECourses•9/18/24, 10:41 AM

yes 2.5 really faster but not as fast as linux :/

Ddi_en_ey Dr. Gozukara, have you got any experiments on greater learning rates than 5e5 wi...

Furkan Gözükara SECourses•9/18/24, 10:41 AM

it will work good on things that are not as delicate as human face

Furkan Gözükara SECourses•9/18/24, 10:41 AM

like styles

Furkan Gözükara SECourses•9/18/24, 10:41 AM

cars