Software Engineering Courses (SECourses)•15mo ago

if you know so much about how Flux dev was created, please tell us how exactly the distillation from

if you know so much about how Flux dev was created, please tell us how exactly the distillation from pro to dev was done, and how DPO was applied (which I'm not doubting - why wouldn't they)

FFurkan Gözükara SECourses ram usage shouldnt be much unless your vram is low

Ereshkigal•10/6/24, 9:11 PM

OK. Just asking cuz I have a 4090 & I've seen upwards of 60GB of system RAM usage when not rendering, when I start a render it goes down (I'm guessing that's loaded on to the gpu).

Ddxqb if you know so much about how Flux dev was created, please tell us how exactly t...

crystalwizard•10/6/24, 9:11 PM

you don't apply dpo to a base model - not if you're smart

dxqbOP•10/6/24, 9:13 PM

tell us why. DPO is proposed as an alternative to RLHF which obviously was applied very successfully for LLMs

Furkan Gözükara SECourses•10/6/24, 9:19 PM

fine tuning configs for 6 gb, 8gb, 10 gb , 12 gb , 16gb and 24 gb

Furkan Gözükara SECourses•10/6/24, 9:19 PM

Ddxqb tell us why. DPO is proposed as an alternative to RLHF which obviously was appl...

crystalwizard•10/6/24, 9:21 PM

I'll let you go read the paper and think

dxqbOP•10/6/24, 9:22 PM

so you don't know the answer. alright.

Ddxqb so you don't know the answer. alright.

crystalwizard•10/6/24, 9:37 PM

i do, but i don't feel like hand-feeding you. and you trying to manipulate me into handing you the research you don't want to do isn't going to work

dxqbOP•10/6/24, 9:38 PM

you are making unsubstantiated claims that you know more about how Flux was created than the general public. anyone can read papers. you have to substantiate your claim.

Ddxqb you are making unsubstantiated claims that you know more about how Flux was crea...

crystalwizard•10/6/24, 9:40 PM

i owe you nothing. i direct you, if you want a place to start your research other than arXiv, to all the posts on this discord ALONE where people talk about how many times they've tried to train flux for something and how it doesn't work. even Furkan himself has expressed issues with that. and that is all i'm giving you for free. go do the research

crystalwizard•10/6/24, 9:40 PM

be just as snarky as you like now, i'm done with you

dxqbOP•10/6/24, 9:41 PM

blocked

crystalwizard•10/6/24, 9:44 PM

blocking on discord is funny. you still see that the other person has posted something, but you can't see what. you can't tell if they're talking about you or not. blocking on discord is a good way to drive yourself crazy. and when you're the one that's tried to start an arguement, and then block the person you were trying to argue with because they wouldn't play your game, that says something about you to everyone watching

B0nd•10/6/24, 9:45 PM

Whats the best upscaler model that allows commercial use?

BB0nd Whats the best upscaler model that allows commercial use?

crystalwizard•10/6/24, 9:45 PM

topaz's models

Ccrystalwizard topaz's models

B0nd•10/6/24, 9:46 PM

can they be intergrated into comfyUI?

BB0nd can they be intergrated into comfyUI?

crystalwizard•10/6/24, 9:47 PM

no. they're propiratory and exclusive to topaz, and not free - but they are the best and you can use the output commercially

Ccrystalwizard no. they're propiratory and exclusive to topaz, and not free - but they are the ...

B0nd•10/6/24, 9:47 PM

yeah its not the output commercially im looking to do. Its for a the backend of a SaaS product.

daroth•10/6/24, 9:53 PM

cmon everyone, be nice to each other

MMaxivi @Dr. Furkan Gözükara have you tried reg images with dreambooth?

dsienra•10/6/24, 9:59 PM

@Dr. Furkan Gözükara you can try flux finetuning with regularization and in the last epochs remove the regularization, may be the model get resemblance at the end but stays more flexible

Ddsienra @Dr. Furkan Gözükara you can try flux finetuning with regularization and in the ...

Furkan Gözükara SECourses•10/6/24, 10:01 PM

it is an idea

Furkan Gözükara SECourses•10/6/24, 10:01 PM

may work

Furkan Gözükara SECourses•10/6/24, 10:02 PM

i am testing each gpu config to get max speed

Furkan Gözükara SECourses•10/6/24, 10:02 PM

man this is taking time

dsienra•10/6/24, 11:41 PM

flux-dev-de-distill is giving this error @kohya_tech is already informed and he said that he will fix it as soon a possible.

Furkan Gözükara SECourses•10/7/24, 12:13 AM

wow batch size 7 way faster than before

Furkan Gözükara SECourses•10/7/24, 12:13 AM

kohya did huge improvement

Furkan Gözükara SECourses•10/7/24, 12:14 AM

training takes under 2 hours haha

Furkan Gözükara SECourses•10/7/24, 12:14 AM

3000 steps

Furkan Gözükara SECourses•10/7/24, 12:19 AM

Furkan Gözükara SECourses•10/7/24, 12:20 AM

ah but my current speed test of batch size 7 not accurate

Furkan Gözükara SECourses•10/7/24, 12:20 AM

i need to give bigger

Furkan Gözükara SECourses•10/7/24, 12:20 AM

ye made the images count 256 testing its speed again

Furkan Gözükara SECourses•10/7/24, 12:22 AM

ye for 256 images not that fast

Furkan Gözükara SECourses•10/7/24, 12:22 AM

so i guess best would be testing 14 images

dsienra•10/7/24, 12:24 AM

@crystalwizard You keep claiming that flux-dev can't be trained I was doing many tests with flux-dev-de-distill, I think that it can work. Its behavior on inference is completely different than regular flux-dev it works perfect without distilled cfg, what they did to model probably works, its behavior is similar to sdxl, if you prompt random you get random noise but if you prompt properly you get a perfect image, on regular flux-dev with distilled cfg you always get a coherent image, did you test it?

Furkan Gözükara SECourses•10/7/24, 12:25 AM

14 images 200 epochs taking 3 hours

Furkan Gözükara SECourses•10/7/24, 12:25 AM

batch size 7

Furkan Gözükara SECourses•10/7/24, 12:25 AM

so total 1$

FFurkan Gözükara SECourses so total 1$

dsienra•10/7/24, 12:27 AM

great price!!

Ddsienra @crystalwizard You keep claiming that flux-dev can't be trained I was doing many...

crystalwizard•10/7/24, 12:33 AM

yeah. i spent a solid month testing flux