Software Engineering Courses (SECourses)•14mo ago

which one i should choose >

Ccyberbol Dr. Furkan. What config you can recommend for me to do fastest way model of face...

Furkan Gözükara SECourses•11/17/24, 11:59 AM

you want lora right?

Ccyberbol which one i should choose >

Furkan Gözükara SECourses•11/17/24, 11:59 AM

it should be faster than 4 second / it

Furkan Gözükara SECourses•11/17/24, 11:59 AM

for you

Furkan Gözükara SECourses•11/17/24, 11:59 AM

like 3 second maybe 2.5

cyberbolOP•11/17/24, 1:49 PM

I did that. Shared video memory should be used ? Its look like that:

cyberbolOP•11/17/24, 1:50 PM

281.40s/it

cyberbolOP•11/17/24, 1:52 PM

cyberbolOP•11/17/24, 1:52 PM

I think something is wrong

cyberbolOP•11/17/24, 2:26 PM

I reinstalled everything again. Now I think its ok

cyberbolOP•11/17/24, 2:26 PM

Ccyberbol Click to see attachment

Furkan Gözükara SECourses•11/17/24, 2:28 PM

now this is a good speed

cyberbolOP•11/17/24, 2:35 PM

Its possible train on rtx 4090 and 64gb ram using dreambox ? or no way as too slow ?

Ccyberbol Its possible train on rtx 4090 and 64gb ram using dreambox ? or no way as too sl...

Furkan Gözükara SECourses•11/17/24, 2:51 PM

dreambox?

cyberbolOP•11/17/24, 3:07 PM

DreamBooth

cyberbolOP•11/17/24, 3:07 PM

Lok

cyberbolOP•11/17/24, 3:07 PM

Ccyberbol DreamBooth

Furkan Gözükara SECourses•11/17/24, 3:21 PM

yes of course you can train even faster than these speeds

Furkan Gözükara SECourses•11/17/24, 3:21 PM

wardensc2•11/17/24, 3:22 PM

Are there anything new for DreamBooth training @Furkan Gözükara SECourses or only for lora training

Wwardensc2 Are there anything new for DreamBooth training <@205854764540362752> or only for...

Furkan Gözükara SECourses•11/17/24, 3:22 PM

new for both check speeds

wardensc2•11/17/24, 3:22 PM

ah ok

wardensc2•11/17/24, 3:23 PM

but base on your config if I want to get the best quality lora with best speed it is faster to train dreambooth and extract

wardensc2•11/17/24, 3:24 PM

and training time still better than train lora

wardensc2•11/17/24, 3:24 PM

only down side is disk space

cyberbolOP•11/17/24, 3:37 PM

So at the moment in my situation Lora training is about 3.58s/it, but if I use DreamBooth instead TIER 1 it will be about 7.3s/it??? as I can see on above picture. So double the time. It's worth you think?. Regarding quality?.

Ccyberbol So at the moment in my situation Lora training is about 3.58s/it, but if I use D...

wardensc2•11/17/24, 3:43 PM

tier 1 in dreambooth is different than tier 1 in lora. In lora the rank you get is 128, but in dreambooth I get the maximum rank is 640

�

🍭🎀 𝒜𝓋𝒶 𝐹𝓇𝒾𝑔𝑔 🎀🍭•11/17/24, 4:18 PM

With 60 training pics for character, is 200 epochs and save every 25 a good setting? I don't think you changed anything about learning rate and other parameters when I watched your tutorial video @Furkan Gözükara SECourses , just use config batch 1? I'm gonna use a80 or h100 later tonight . Want to complete it as fast as possible, with highest possible quality.

cyberbolOP•11/17/24, 4:29 PM

Oh my God. My computer froze at 48% of the Lora training. Can I somehow resume the training? Or do I have to start over?

cyberbolOP•11/17/24, 6:30 PM

Now i know we need MARK some option in Koya to be able later resume training

cyberbolOP•11/17/24, 6:30 PM

Under PArameters - Advence

cyberbolOP•11/17/24, 6:31 PM

cyberbolOP•11/17/24, 6:31 PM

You should mention about this Boss.

Ccyberbol Oh my God. My computer froze at 48% of the Lora training. Can I somehow resume t...

Furkan Gözükara SECourses•11/17/24, 8:35 PM

you can continue from last checkpoint lora too

Furkan Gözükara SECourses•11/17/24, 8:36 PM

�🍭🎀 𝒜𝓋𝒶 𝐹𝓇𝒾𝑔𝑔 🎀🍭With 60 training pics for character, is 200 epochs and save every 25 a good sett...

Furkan Gözükara SECourses•11/17/24, 8:36 PM

it is good

Furkan Gözükara SECourses•11/17/24, 8:36 PM

for batch size 1 L40S is good choice others are not worth very much

�

🍭🎀 𝒜𝓋𝒶 𝐹𝓇𝒾𝑔𝑔 🎀🍭•11/17/24, 8:39 PM

Oh, L40S will be faster, but quality output will be same as a6000 yes?

�🍭🎀 𝒜𝓋𝒶 𝐹𝓇𝒾𝑔𝑔 🎀🍭Oh, L40S will be faster, but quality output will be same as a6000 yes?

Furkan Gözükara SECourses•11/17/24, 8:41 PM

yes

Furkan Gözükara SECourses•11/17/24, 8:41 PM

but A6000 is the most price / performance

Furkan Gözükara SECourses•11/17/24, 8:41 PM

on massed compute

�

🍭🎀 𝒜𝓋𝒶 𝐹𝓇𝒾𝑔𝑔 🎀🍭•11/17/24, 8:42 PM

Oh, so if I want fastest possible training, it's the h100.

FFurkan Gözükara SECourses but A6000 is the most price / performance

�

🍭🎀 𝒜𝓋𝒶 𝐹𝓇𝒾𝑔𝑔 🎀🍭•11/17/24, 8:43 PM

rented 1 comp for a month with a6000, at the end of the month, it was so slow, totally unresponsive, i was not even able to do a restart, so had to delete the deployment and redeploy. Maybe I should have restarted the machine more during that month, or maybe you're not supposed to rent it for that long in one run.

�🍭🎀 𝒜𝓋𝒶 𝐹𝓇𝒾𝑔𝑔 🎀🍭rented 1 comp for a month with a6000, at the end of the month, it was so slow, t...

Furkan Gözükara SECourses•11/17/24, 8:45 PM

was it runpod?

�

🍭🎀 𝒜𝓋𝒶 𝐹𝓇𝒾𝑔𝑔 🎀🍭•11/17/24, 8:51 PM

massed compute

�🍭🎀 𝒜𝓋𝒶 𝐹𝓇𝒾𝑔𝑔 🎀🍭massed compute

Furkan Gözükara SECourses•11/17/24, 8:51 PM

they rarely have bad machines

Furkan Gözükara SECourses•11/17/24, 8:51 PM

if you report machine id here

Furkan Gözükara SECourses•11/17/24, 8:51 PM