Software Engineering Courses (SECourses)•10mo ago

torch vision arrived amazing

Furkan Gözükara SECoursesOP•2/26/25, 2:33 PM

now all i have to do is compile flash attention

Jean-lu•2/26/25, 2:41 PM

Hi guys Im new here so please let me know if this question doesn't go here. But Im trying to train lora's using fluxgym I have a couple of questions / issues -

My training datatset is of kids (age 5-13) with max 15-20 photos. But even with an A100 40GB it takes around 2hrs to train. Any fix for that? I love how fal.ai does the fast training Im okay with even an hour but 2-3 gets tiresome
I tried with increasing batch size for perfomance but seems like they kinda ruin the quality. Any advice to how to maintain quality with perfomance? captions yay or nay? size 1024 or 512?

FFurkan Gözükara SECourses torch vision arrived amazing

1nfern0•2/26/25, 2:46 PM

does that mean you can stretch the 5090's legs soon. I haven't been able to test the app yet with work getting in the way.

JJean-lu Hi guys Im new here so please let me know if this question doesn't go here. But ...

Furkan Gözükara SECoursesOP•2/26/25, 2:47 PM

it is quality vs time

11nfern0 does that mean you can stretch the 5090's legs soon. I haven't been able to te...

Furkan Gözükara SECoursesOP•2/26/25, 2:47 PM

i am trying to compile flash attention noıw

FFurkan Gözükara SECourses ye

1nfern0•2/26/25, 2:47 PM

ohh wow, things are starting to move along nicely

11nfern0 ohh wow, things are starting to move along nicely

Furkan Gözükara SECoursesOP•2/26/25, 2:48 PM

yep

Furkan Gözükara SECoursesOP•2/26/25, 2:55 PM

Furkan Gözükara SECoursesOP•2/26/25, 2:55 PM

flash attention compile lets see i hope works

FFurkan Gözükara SECourses therre is fp8 option can you test it?

computersheep•2/26/25, 3:37 PM

FP8 will be extra slow on any gpu before the nvidia Lovelace generation
like A6000, 3090, A100 dont have the chips needed to perform well with FP8

L40, 4090, h100 would be good cards for FP8

just incase anyone cares