Software Engineering Courses (SECourses)•16mo ago

I've just trained a very bad dataset on flux. Blurry, mixed resolution down to 128px. For SDXL, I ha

I've just trained a very bad dataset on flux. Blurry, mixed resolution down to 128px. For SDXL, I have carefully prepared it using SUPIR and more. With flux, it just works without preparation. This model is insane

Ddxqb I've just trained a very bad dataset on flux. Blurry, mixed resolution down to 1...

Furkan Gözükara SECourses•9/18/24, 10:00 PM

so true

Furkan Gözükara SECourses•9/18/24, 10:00 PM

with flux you can only get better

Furkan Gözükara SECourses•9/18/24, 10:00 PM

i plan to do general fine tuning with our 20k images but i need at least 2x A100 like 1 week

Furkan Gözükara SECourses•9/18/24, 10:01 PM

48gb fine tuning fails at multi gpu

dxqbOP•9/18/24, 10:05 PM

what's the goal?

Ddxqb what's the goal?

Furkan Gözükara SECourses•9/18/24, 10:09 PM

that model may work better for training a person afterwards

Furkan Gözükara SECourses•9/18/24, 10:09 PM

not sure though a good experiment

dxqbOP•9/18/24, 10:12 PM

ah, yeah might be a good model. it can be trained towards realism very easily, but without any lora it looks very AI generated

dxqbOP•9/18/24, 10:12 PM

probably was trained on generated data

Furkan Gözükara SECourses•9/19/24, 12:13 AM

started a fine tuning training for a client with 100 images

Furkan Gözükara SECourses•9/19/24, 12:13 AM

very unique case

Furkan Gözükara SECourses•9/19/24, 12:13 AM

Furkan Gözükara SECourses•9/19/24, 12:13 AM

lets see what we will get

Furkan Gözükara SECourses•9/19/24, 12:14 AM

it sucks that fine tuning doesnt fit into 48 gb with multi gpu

Furkan Gözükara SECourses•9/19/24, 1:07 AM

just published an amazing article : https://www.patreon.com/posts/112335162?pr=true

Patreon

How to Extract LoRA from FLUX Fine Tuning / DreamBooth Training Ful...

Get more from SECourses: Tutorials, Guides, Resources, Training, FLUX, MidJourney, Voice Clone, TTS, ChatGPT, GPT, LLM, Scripts by Furkan Gözü on Patreon

Neo•9/19/24, 2:24 AM

oooooooh thank you doc

FFurkan Gözükara SECourses started a fine tuning training for a client with 100 images

Neo•9/19/24, 2:26 AM

Thanks, it will be useful to me as well, as discussed before with you I often have datasets in that range (100-250imgs). Curious as to the concept category being trained, is this for a person or style, etc?

NNeo Thanks, it will be useful to me as well, as discussed before with you I often ha...

Furkan Gözükara SECourses•9/19/24, 2:54 AM

Person

Furkan Gözükara SECourses•9/19/24, 2:54 AM

I plan to general fine tune with 20400 images

Furkan Gözükara SECourses•9/19/24, 2:54 AM

Captioning right now

Furkan Gözükara SECourses•9/19/24, 2:54 AM

But it will be on single gpu :/

Darth Teethius•9/19/24, 4:00 AM

Has anyobe figured out the specific block training in kohya?

FFurkan Gözükara SECourses you can use Rank_4_17250MB_4_85_Second_IT.json it is pretty decent speed

TheJayHole•9/19/24, 4:08 AM

TYVM

FFurkan Gözükara SECourses just published an amazing article : https://www.patreon.com/posts/112335162?pr=t...

dxqbOP•9/19/24, 5:35 AM

do kohya merge tools already work with flux? I'd like to train on a checkpoint that was merged with a Lora

dxqbOP•9/19/24, 5:36 AM

and, do you already have any insights on DoRA? the claim is that it closes the gap between Lora and Finetune. Is it correct? OT has implemented Dora recently, I think kohya had it for longer

Kallamamran•9/19/24, 5:59 AM

What does the numbers under the image in Forge mean?
A: 18.65 GB, R: 20.05 GB, Sys: 21.7/24 GB (90.5%)

R=RAM? Sys=VRAM? A=??

liorftw•9/19/24, 7:06 AM

Hey I saw there is new things that he posted, the last thing I did is train a lora with my data, what's now the best thing? I saw there is lora extraction what does it mean?

Kallamamran•9/19/24, 8:34 AM

Finetuning really doesn't work at all for me...

Kallamamran•9/19/24, 8:34 AM

It's supposed to be this car

Kallamamran•9/19/24, 8:34 AM

Horrible results

Kallamamran•9/19/24, 8:35 AM

That's at LR 0.0001 since 0.00004 didn't learn anything

KKallamamran It's supposed to be this car

�

𝗡𝗶𝘁𝗶𝗻 𝗣𝗮𝗿𝗲𝘃𝗮•9/19/24, 9:36 AM

What network dim and alpha are you using and how many images?

Kallamamran•9/19/24, 9:59 AM

Kallamamran•9/19/24, 10:02 AM

I can't find network dim and alpha in Dreambooth settings

KKallamamran Click to see attachment

�

𝗡𝗶𝘁𝗶𝗻 𝗣𝗮𝗿𝗲𝘃𝗮•9/19/24, 10:05 AM

You can easily train a Lora on this using doc's config and why are you repeating images it will cause overfitting

B0nd•9/19/24, 10:30 AM

getting issues trying to install and run swarm on runpod - Failed init of ComfyUI-0 with script target 'dlbackend/ComfyUI/main.py' because that file does not exist. Please verify your start script location.