Software Engineering Courses (SECourses)•15mo ago

I have multiple product images, if I train lora for each product and merge loras will work? did you

I have multiple product images, if I train lora for each product and merge loras will work?
did you try merging loras earlier?

Ssumanth I have multiple product images, if I train lora for each product and merge loras...

Furkan Gözükara SECourses•10/15/24, 9:43 AM

it will bleed

Furkan Gözükara SECourses•10/15/24, 9:44 AM

that is what de distilled models may fix

Furkan Gözükara SECourses•10/15/24, 9:44 AM

hopefully it is next research

sumanthOP•10/15/24, 9:50 AM

got it, even sdxl models wont produce good results with lora merge? or checkpoint train + merge will work?

Ssumanth got it, even sdxl models wont produce good results with lora merge? or checkpoin...

Furkan Gözükara SECourses•10/15/24, 9:57 AM

SDXL should work fairly well

Furkan Gözükara SECourses•10/15/24, 9:57 AM

for flux still bleeds with base 23.8 gb dev model

sumanthOP•10/15/24, 9:59 AM

understood, thank you!

Furkan Gözükara SECourses•10/15/24, 10:03 AM

triton 3 published i think testing

FFurkan Gözükara SECourses ohwx bald man

tazztone•10/15/24, 10:16 AM

wow FLUX even adding hair to a skeleton...

Ttazztone wow FLUX even adding hair to a skeleton...

Furkan Gözükara SECourses•10/15/24, 10:18 AM

powerful

SiggiSmilez•10/15/24, 11:02 AM

@Dr. Furkan Gözükara can I use your tutorial to fine tune an already fine tuned flux model?

snowmonkey•10/15/24, 11:04 AM

@Dr. Furkan Gözükara Do you have a tutorial for setting up Flux locally on OSX ?

SSiggiSmilez @Dr. Furkan Gözükara can I use your tutorial to fine tune an already fine tuned ...

Furkan Gözükara SECourses•10/15/24, 11:36 AM

yes

Ssnowmonkey @Dr. Furkan Gözükara Do you have a tutorial for setting up Flux locally on OSX ?

Furkan Gözükara SECourses•10/15/24, 11:36 AM

sadly not

Furkan Gözükara SECourses•10/15/24, 11:36 AM

i only have windows and linux tutorials

Furkan Gözükara SECourses•10/15/24, 11:37 AM

good news triton 3 now working

Furkan Gözükara SECourses•10/15/24, 11:37 AM

we are talking with dev

Furkan Gözükara SECourses•10/15/24, 11:37 AM

https://github.com/woct0rdho/triton/issues/3

GitHub

Let's test the wheels · Issue #3 · woct0rdho/triton

Now the wheels are published in releases.

Furkan Gözükara SECourses•10/15/24, 11:50 AM

triton 3 published : https://www.reddit.com/r/StableDiffusion/comments/1g45n6n/triton_3_wheels_published_for_windows_and_working/

From the StableDiffusion community on Reddit: Triton 3 wheels publi...

Explore this post and more from the StableDiffusion community

FFurkan Gözükara SECourses triton 3 published : https://www.reddit.com/r/StableDiffusion/comments/1g45n6n/t...

J2_Nedo•10/15/24, 12:08 PM

so for this to work, we need to update all ai apps or just this triton, i will wait until its clear what exsactly to do.

JJ2_Nedo so for this to work, we need to update all ai apps or just this triton, i will w...

Furkan Gözükara SECourses•10/15/24, 12:20 PM

you need to just install it into venvs

Furkan Gözükara SECourses•10/15/24, 12:20 PM

of your apps

Furkan Gözükara SECourses•10/15/24, 12:20 PM

i will include it to my installers

Furkan Gözükara SECourses•10/15/24, 12:21 PM

slowly

Furkan Gözükara SECourses•10/15/24, 2:18 PM

hopefully i will make a triton tutorial today

Furkan Gözükara SECourses•10/15/24, 2:18 PM

time to update some installers

deepblue_1337•10/15/24, 2:24 PM

I Installed the "Kohya_GUI_Flux_Installer_v40" script which works perfectly for flux.
However I also want to train an sdxl model.
When trying to do so I get the error "ModuleNotFoundError: No module named 'xformers'".

Is pip install xformers the correct way?

Noel Camus•10/15/24, 2:36 PM

dreambooth fine-tuning should i choose float? i remember lora is float.

Ddeepblue_1337 I Installed the "Kohya_GUI_Flux_Installer_v40" script which works perfectly for ...

Furkan Gözükara SECourses•10/15/24, 2:38 PM

currently xformers not supported on torch 2.5

Furkan Gözükara SECourses•10/15/24, 2:38 PM

so make a seperate install and dont run torch 2.5

NNoel Camus dreambooth fine-tuning should i choose float? i remember lora is float.

Furkan Gözükara SECourses•10/15/24, 2:39 PM

float is best

Furkan Gözükara SECourses•10/15/24, 2:39 PM

but fp16 also works decent

Zet•10/15/24, 2:40 PM

No matter what Rank config I use, I run out of VRAM

Lora Training/16GB Vram, using Rank 5
Idle 0.5/16GB used
Are there any updates in branch sd3-flux.1 that are not accounted for in the .json files? Settings wise? I must be missing something

Noel Camus•10/15/24, 2:42 PM

thanks