Software Engineering Courses (SECourses)•16mo ago

@Dr. Furkan Gözükara do you know anything about Fluxgym, have you tried it or is it in your plans?

@Dr. Furkan Gözükara do you know anything about Fluxgym, have you tried it or is it in your plans? they say that it works with kohya sd-scripts... the most powerful training script for Stable Diffusion, Flux, etc.

I just saw that information that's why my query

Darth Teethius•9/17/24, 4:56 AM

has anyone tried reg images with flux yet?

FFurkan Gözükara SECourses starting single layer training experiments

druhl•9/17/24, 5:43 AM

I thought Kohya did not have that function, is it released now?

DDarth Teethius has anyone tried reg images with flux yet?

druhl•9/17/24, 5:43 AM

Does not work. Doc has tested and posted his experiments.

LLuiz xd @Dr. Furkan Gözükara do you know anything about Fluxgym, have you tried it or i...

druhl•9/17/24, 5:44 AM

Is this the ComfyUI one or the standalone website one?

AstraBat•9/17/24, 6:22 AM

My flux fine tuning is chugging away on a 24gb card. I notice that the s/its value gets a little longer with each epoch. It was at 9 s/it and has crept to 20 s/it by epoch 20. My vram sits at 24 gb with 0.6 gb in regular ram.

FFurkan Gözükara SECourses Click to see attachment

Kallamamran•9/17/24, 6:36 AM

That flexibility!

Kallamamran•9/17/24, 6:36 AM

That's dreambooth finetune?

DDarth Teethius has anyone tried reg images with flux yet?

Kallamamran•9/17/24, 6:38 AM

Doesn't work

FFurkan Gözükara SECourses probably you need lora

slipkn67•9/17/24, 10:11 AM

you think 15 scar images would be enough to generate lora to draw realistic big cut scar on my face?

Jjvmbo I got this warning while doing install Step 2 for Kohya. The bat files you've pr...

Furkan Gözükara SECourses•9/17/24, 10:18 AM

yep latest one will fix the issues dont worryu

LLuiz xd @Dr. Furkan Gözükara do you know anything about Fluxgym, have you tried it or i...

Furkan Gözükara SECourses•9/17/24, 10:19 AM

i dont plan kohya gui working fine

DDarth Teethius has anyone tried reg images with flux yet?

Furkan Gözükara SECourses•9/17/24, 10:19 AM

i tried doesnt work

Furkan Gözükara SECourses•9/17/24, 10:19 AM

did like 6-7 different trainings

Ddruhl I thought Kohya did not have that function, is it released now?

Furkan Gözükara SECourses•9/17/24, 10:19 AM

published yesterday

Furkan Gözükara SECourses•9/17/24, 10:19 AM

testing check points right now

KKallamamran That's dreambooth finetune?

Furkan Gözükara SECourses•9/17/24, 10:19 AM

yes

Sslipkn67 you think 15 scar images would be enough to generate lora to draw realistic big ...

Furkan Gözükara SECourses•9/17/24, 10:20 AM

more usually better

Ddruhl Is this the ComfyUI one or the standalone website one?

Luiz xdOP•9/17/24, 10:21 AM

https://x.com/cocktailpeanut/status/1835719722425602543

LLuiz xd https://x.com/cocktailpeanut/status/1835719722425602543

Furkan Gözükara SECourses•9/17/24, 10:40 AM

i dont see any reason to invest in this

Furkan Gözükara SECourses•9/17/24, 10:40 AM

kohya gui working good and the guy is fixing errors

Furkan Gözükara SECourses•9/17/24, 10:40 AM

none of the single layers looks like me i assume it will require a new learning rate

FFurkan Gözükara SECourses none of the single layers looks like me i assume it will require a new learning ...

�

𝗡𝗶𝘁𝗶𝗻 𝗣𝗮𝗿𝗲𝘃𝗮•9/17/24, 10:44 AM

You can use the layers he mentions here - https://www.reddit.com/r/StableDiffusion/comments/1f523bd/good_flux_loras_can_be_less_than_45mb_128_dim/?utm_source=share&utm_medium=web3x&utm_name=web3xcss&utm_term=1&utm_content=share_button

From the StableDiffusion community on Reddit: Good Flux LoRAs can b...

Explore this post and more from the StableDiffusion community

�𝗡𝗶𝘁𝗶𝗻 𝗣𝗮𝗿𝗲𝘃𝗮 You can use the layers he mentions here - https://www.reddit.com/r/StableDiffusi...

Furkan Gözükara SECourses•9/17/24, 11:14 AM

i tested 0 to 7 none looks a like

Furkan Gözükara SECourses•9/17/24, 11:14 AM

i think new LR is mandatory

�

𝗡𝗶𝘁𝗶𝗻 𝗣𝗮𝗿𝗲𝘃𝗮•9/17/24, 11:19 AM

might be the case then

Tacite•9/17/24, 11:52 AM

training on layer 7 and layer 20 is not too bad. Using noise_scheduler: flowmatch, optimizer: adamw8bit and lr: 0.0005

TTacite training on layer 7 and layer 20 is not too bad. Using noise_scheduler: flowmat...

Furkan Gözükara SECourses•9/17/24, 12:59 PM

ye your LR is 10x of mine

Furkan Gözükara SECourses•9/17/24, 12:59 PM

i am doing more trainings

Furkan Gözükara SECourses•9/17/24, 12:59 PM

atm

Zono50•9/17/24, 1:18 PM

@Dr. Furkan Gözükara so supir tool was built using cudatoolkit 11.8? but xformers is looking for pytorch 2.4.0 +cu121, i'm confused

Zono50•9/17/24, 1:19 PM

not sure why it says that cause i don't even have pytorch 2.2.0 installed i have 2.4.0

PixelMonkey•9/17/24, 1:20 PM

Question in the round of you awesome nerds

. Iw as trying the last days control net with flux in SD Forge webUi but it seems broken.. neither the Depoth or the Canny mode worked for me .. Any one having the same issue ?

ZZono50 @Dr. Furkan Gözükara so supir tool was built using cudatoolkit 11.8? but xforme...

Furkan Gözükara SECourses•9/17/24, 1:24 PM

use our installer it handles all

FFurkan Gözükara SECourses Click to see attachment

smoke•9/17/24, 1:33 PM

Will you be doing finetune vs lora comparisons?

Ssmoke Will you be doing finetune vs lora comparisons?

Furkan Gözükara SECourses•9/17/24, 1:35 PM

yep i already did too

smoke•9/17/24, 1:36 PM

Oh you already did?

Furkan Gözükara SECourses•9/17/24, 1:36 PM

check images

Furkan Gözükara SECourses•9/17/24, 1:36 PM

https://www.patreon.com/posts/full-fine-tuning-112157789

Patreon

Full Fine Tuning / DreamBooth of FLUX yields way better results tha...

Get more from SECourses: Tutorials, Guides, Resources, Training, FLUX, MidJourney, Voice Clone, TTS, ChatGPT, GPT, LLM, Scripts by Furkan Gözü on Patreon

Furkan Gözükara SECourses•9/17/24, 1:36 PM

left best lora right fine tune

smoke•9/17/24, 1:37 PM

Hmmm I see, finetune better for sure. Have you also tried finetune lora extract? I tried that but the quality dropped drastically, something was definitely wrong with the lora extract script

Ssmoke Hmmm I see, finetune better for sure. Have you also tried finetune lora extract?...

Furkan Gözükara SECourses•9/17/24, 1:59 PM

not tried yet

Furkan Gözükara SECourses•9/17/24, 1:59 PM

but it should be better than lora training it self

smoke•9/17/24, 2:00 PM

Yeah I also think that. I'd use it but that lora extract script is fully broken, atleast for me. And keeping those huge checkpoints is a bit much

FFurkan Gözükara SECourses ye your LR is 10x of mine 😄

�

𝗡𝗶𝘁𝗶𝗻 𝗣𝗮𝗿𝗲𝘃𝗮•9/17/24, 2:12 PM

what network dim and alpha are you using?

Kallamamran•9/17/24, 3:05 PM

@Dr. Furkan Gözükara I can't seem to find that captioning editor GUI you've made. Would you mind linking to it?

FFurkan Gözükara SECourses i tested 0 to 7 none looks a like

dsienra•9/17/24, 3:34 PM

I want to try this but I have some questions, layes=bloks what's the diference between single and double blocks? you are testing with single blocks or layers? can I test with 7 and 20 using a higher lr, let us know your findings, thanks

�𝗡𝗶𝘁𝗶𝗻 𝗣𝗮𝗿𝗲𝘃𝗮 what network dim and alpha are you using?

Furkan Gözükara SECourses•9/17/24, 3:56 PM

128x128

KKallamamran @Dr. Furkan Gözükara I can't seem to find that captioning editor GUI you've made...

Furkan Gözükara SECourses•9/17/24, 3:58 PM

https://www.patreon.com/posts/108992085

Patreon

Image Captioning Editor Gradio APP - Edit Your Captions Super Easy ...

Get more from SECourses: Tutorials, Guides, Resources, Training, FLUX, MidJourney, Voice Clone, TTS, ChatGPT, GPT, LLM, Scripts by Furkan Gözü on Patreon

Ddsienra I want to try this but I have some questions, layes=bloks what's the diference...

Furkan Gözükara SECourses•9/17/24, 3:58 PM

that is what i am testing now :d

Furkan Gözükara SECourses•9/17/24, 3:58 PM

done 16 trainings so far training 8 more

@Dr. Furkan Gözükara do you know anything about Fluxgym, have you tried it or is it in your plans?

Similar Threads