Software Engineering Courses (SECourses)•17mo ago

9 gb lora training?!?!?!

DDarth Teethius 9 gb lora training?!?!?!

Furkan Gözükara SECourses•8/22/24, 12:57 AM

yep

Furkan Gözükara SECourses•8/22/24, 12:57 AM

with 128 rank it uses 9.8 gb

Furkan Gözükara SECourses•8/22/24, 12:57 AM

i am updating patreon

Darth TeethiusOP•8/22/24, 12:57 AM

I cant wait

Darth TeethiusOP•8/22/24, 12:58 AM

As always you rock!

Furkan Gözükara SECourses•8/22/24, 1:01 AM

config added

Furkan Gözükara SECourses•8/22/24, 1:01 AM

i dont have the results yet will have tomorrow hopefully

Furkan Gözükara SECourses•8/22/24, 1:01 AM

set according to my best config so far

Vs12•8/22/24, 1:01 AM

@Dr. Furkan Gözükara 1.16s/it for me

VVs12 @Dr. Furkan Gözükara 1.16s/it for me

Furkan Gözükara SECourses•8/22/24, 1:01 AM

24 second / it for RTX 3060

Vs12•8/22/24, 1:01 AM

17gb vram

FFurkan Gözükara SECourses 24 second / it for RTX 3060 😄

Vs12•8/22/24, 1:02 AM

https://tenor.com/view/relatable-stressed-gif-27439196

Tenor

VVs12 @Dr. Furkan Gözükara 1.16s/it for me

Furkan Gözükara SECourses•8/22/24, 1:02 AM

super fast

Furkan Gözükara SECourses•8/22/24, 1:02 AM

on A6000 it is 8.3 second / it but didnt test latest

Furkan Gözükara SECourses•8/22/24, 1:02 AM

will do today

FFurkan Gözükara SECourses super fast

Vs12•8/22/24, 1:02 AM

you should get 50% speed boost on your 3090

VVs12 you should get 50% speed boost on your 3090

Furkan Gözükara SECourses•8/22/24, 1:02 AM

17 gb is also amazing

FFurkan Gözükara SECourses flux lora training with 9 gb 😄

�

𝔸𝖨ΞӾ•8/22/24, 1:03 AM

World's first 9gb training?!

Furkan Gözükara SECourses•8/22/24, 1:03 AM

i wont be needed to reduce lora rank

Vs12•8/22/24, 1:03 AM

seems new cudnn less vram and faster

�𝔸𝖨ΞӾ World's first 9gb training?! 😱

Furkan Gözükara SECourses•8/22/24, 1:03 AM

yep

Vs12•8/22/24, 1:03 AM

Memory efficient attention?

VVs12 Memory efficient attention?

Furkan Gözükara SECourses•8/22/24, 1:05 AM

not enabled

Furkan Gözükara SECourses•8/22/24, 1:05 AM

i tested it makes 0 diff

Furkan Gözükara SECourses•8/22/24, 1:07 AM

shared video of 9 gb training : https://www.reddit.com/r/StableDiffusion/comments/1ey6hss/kohya_ss_gui_flux_lora_training_on_rtx_3060_lora/

From the StableDiffusion community on Reddit: Kohya SS GUI FLUX LoR...

Explore this post and more from the StableDiffusion community

FFurkan Gözükara SECourses shared video of 9 gb training : https://www.reddit.com/r/StableDiffusion/comment...

Vs12•8/22/24, 1:08 AM

interesting, would it work with dreambooth?

Vs12•8/22/24, 1:08 AM

also are you training 1024?

VVs12 also are you training 1024?

Furkan Gözükara SECourses•8/22/24, 1:08 AM

1024x1024

Furkan Gözükara SECourses•8/22/24, 1:08 AM

dreambooth wont be this much this is half model

Vs12•8/22/24, 1:08 AM

have you noticed any difference with 512 compared to 1024?

VVs12 have you noticed any difference with 512 compared to 1024?

Furkan Gözükara SECourses•8/22/24, 1:09 AM

never tested 512

Vs12•8/22/24, 1:09 AM

for me same results and 3x faster

VVs12 for me same results and 3x faster

Furkan Gözükara SECourses•8/22/24, 1:09 AM

same results doesnt make sense weird :

Furkan Gözükara SECourses•8/22/24, 1:10 AM

i should test today

Vs12•8/22/24, 1:10 AM

actually 1024 might be worse

Vs12•8/22/24, 1:10 AM

flux loves 512

Vs12•8/22/24, 1:10 AM

bucketing though

Vs12•8/22/24, 1:10 AM

i have images that ar 3000pixels

Vs12•8/22/24, 1:10 AM

and results are great

VVs12 i have images that ar 3000pixels

Furkan Gözükara SECourses•8/22/24, 1:10 AM

what do you mean

Vs12•8/22/24, 1:11 AM

like i train very high quality images

Vs12•8/22/24, 1:11 AM

they bucket down to 512

Vs12•8/22/24, 1:11 AM

and results are amazing

Furkan Gözükara SECourses•8/22/24, 1:11 AM

so they are basically 512

Furkan Gözükara SECourses•8/22/24, 1:11 AM

downscaled to

Vs12•8/22/24, 1:11 AM

yes, but i also tested with 1024, and 512 is much better

VVs12 yes, but i also tested with 1024, and 512 is much better

Furkan Gözükara SECourses•8/22/24, 1:12 AM

i am gonna test thanks and weird :d

Vs12•8/22/24, 1:12 AM

very weird yes

Vs12•8/22/24, 1:12 AM

but flux for some reason loves 512 better

FFurkan Gözükara SECourses i am gonna test thanks and weird :d

Vs12•8/22/24, 1:12 AM

all good

9 gb lora training?!?!?!

Similar Threads

Similar Threads

Similar Threads