Software Engineering Courses (SECourses)•16mo ago

just published an amazing article : https://www.patreon.com/posts/112335162?pr=true

Patreon

How to Extract LoRA from FLUX Fine Tuning / DreamBooth Training Ful...

Get more from SECourses: Tutorials, Guides, Resources, Training, FLUX, MidJourney, Voice Clone, TTS, ChatGPT, GPT, LLM, Scripts by Furkan Gözü on Patreon

Neo•9/19/24, 2:24 AM

oooooooh thank you doc

FFurkan Gözükara SECourses started a fine tuning training for a client with 100 images

Neo•9/19/24, 2:26 AM

Thanks, it will be useful to me as well, as discussed before with you I often have datasets in that range (100-250imgs). Curious as to the concept category being trained, is this for a person or style, etc?

NNeo Thanks, it will be useful to me as well, as discussed before with you I often ha...

Furkan Gözükara SECoursesOP•9/19/24, 2:54 AM

Person

Furkan Gözükara SECoursesOP•9/19/24, 2:54 AM

I plan to general fine tune with 20400 images

Furkan Gözükara SECoursesOP•9/19/24, 2:54 AM

Captioning right now

Furkan Gözükara SECoursesOP•9/19/24, 2:54 AM

But it will be on single gpu :/

Darth Teethius•9/19/24, 4:00 AM

Has anyobe figured out the specific block training in kohya?

FFurkan Gözükara SECourses you can use Rank_4_17250MB_4_85_Second_IT.json it is pretty decent speed

TheJayHole•9/19/24, 4:08 AM

TYVM

FFurkan Gözükara SECourses just published an amazing article : https://www.patreon.com/posts/112335162?pr=t...

dxqb•9/19/24, 5:35 AM

do kohya merge tools already work with flux? I'd like to train on a checkpoint that was merged with a Lora

dxqb•9/19/24, 5:36 AM

and, do you already have any insights on DoRA? the claim is that it closes the gap between Lora and Finetune. Is it correct? OT has implemented Dora recently, I think kohya had it for longer

Kallamamran•9/19/24, 5:59 AM

What does the numbers under the image in Forge mean?
A: 18.65 GB, R: 20.05 GB, Sys: 21.7/24 GB (90.5%)

R=RAM? Sys=VRAM? A=??

liorftw•9/19/24, 7:06 AM

Hey I saw there is new things that he posted, the last thing I did is train a lora with my data, what's now the best thing? I saw there is lora extraction what does it mean?

Kallamamran•9/19/24, 8:34 AM

Finetuning really doesn't work at all for me...

Kallamamran•9/19/24, 8:34 AM

It's supposed to be this car

Kallamamran•9/19/24, 8:34 AM

Horrible results

Kallamamran•9/19/24, 8:35 AM

That's at LR 0.0001 since 0.00004 didn't learn anything

KKallamamran It's supposed to be this car

�

𝗡𝗶𝘁𝗶𝗻 𝗣𝗮𝗿𝗲𝘃𝗮•9/19/24, 9:36 AM

What network dim and alpha are you using and how many images?

Kallamamran•9/19/24, 9:59 AM

Kallamamran•9/19/24, 10:02 AM

I can't find network dim and alpha in Dreambooth settings

KKallamamran Click to see attachment

�

𝗡𝗶𝘁𝗶𝗻 𝗣𝗮𝗿𝗲𝘃𝗮•9/19/24, 10:05 AM

You can easily train a Lora on this using doc's config and why are you repeating images it will cause overfitting

B0nd•9/19/24, 10:30 AM

getting issues trying to install and run swarm on runpod - Failed init of ComfyUI-0 with script target 'dlbackend/ComfyUI/main.py' because that file does not exist. Please verify your start script location.

DDarth Teethius Has anyobe figured out the specific block training in kohya?

Furkan Gözükara SECoursesOP•9/19/24, 10:51 AM

yes i did

Furkan Gözükara SECoursesOP•9/19/24, 10:51 AM

i experimented too

Furkan Gözükara SECoursesOP•9/19/24, 10:51 AM

hopefully will publish today

Ddxqb and, do you already have any insights on DoRA? the claim is that it closes the g...

Furkan Gözükara SECoursesOP•9/19/24, 10:51 AM

kohya doesnt have dora as far as i know

Lliorftw Hey I saw there is new things that he posted, the last thing I did is train a lo...

Furkan Gözükara SECoursesOP•9/19/24, 10:51 AM

fine tuning / dreambooth best

KKallamamran Finetuning really doesn't work at all for me...

Furkan Gözükara SECoursesOP•9/19/24, 10:52 AM

you need to train your car same as person

Furkan Gözükara SECoursesOP•9/19/24, 10:52 AM

logic

BB0nd getting issues trying to install and run swarm on runpod - Failed init of ComfyU...

Furkan Gözükara SECoursesOP•9/19/24, 10:53 AM

i installed like yesterday worked perfect

Furkan Gözükara SECoursesOP•9/19/24, 10:53 AM

could be pod broken

B0nd•9/19/24, 10:53 AM

Ive tried 3 times

B0nd•9/19/24, 10:53 AM

fresh pod each time

BB0nd fresh pod each time

Furkan Gözükara SECoursesOP•9/19/24, 10:53 AM

are you using latest installer sh file?

B0nd•9/19/24, 10:53 AM

I think so

B0nd•9/19/24, 10:53 AM

do you have a link?

BB0nd do you have a link?

Furkan Gözükara SECoursesOP•9/19/24, 10:54 AM

https://www.patreon.com/posts/106135985

Patreon

SwarmUI Master Tutorial - Use Stable Diffusion 3 (SD3) and FLUX mod...

Get more from SECourses: Tutorials, Guides, Resources, Training, FLUX, MidJourney, Voice Clone, TTS, ChatGPT, GPT, LLM, Scripts by Furkan Gözü on Patreon

B0nd•9/19/24, 10:55 AM

ill try it again

B0nd•9/19/24, 11:04 AM

fresh install

B0nd•9/19/24, 11:04 AM

just did the same

B0nd•9/19/24, 11:05 AM

using the install.sh attached here - https://www.patreon.com/posts/106135985

Patreon

SwarmUI Master Tutorial - Use Stable Diffusion 3 (SD3) and FLUX mod...

Get more from SECourses: Tutorials, Guides, Resources, Training, FLUX, MidJourney, Voice Clone, TTS, ChatGPT, GPT, LLM, Scripts by Furkan Gözü on Patreon

B0nd•9/19/24, 11:05 AM

Failed init of ComfyUI-0 with script target 'dlbackend/ComfyUI/main.py' because that file does not exist. Please verify your start script location.

Furkan Gözükara SECoursesOP•9/19/24, 11:09 AM

1 sec tsting

B0nd•9/19/24, 11:11 AM

Ok thanks

FFurkan Gözükara SECourses you need to train your car same as person

Kallamamran•9/19/24, 11:19 AM

I did and it was even worse

Kallamamran•9/19/24, 11:20 AM

I have inconsistency with Forge now as well

Kallamamran•9/19/24, 11:20 AM