Software Engineering Courses (SECourses)•15mo ago

I didnt' think so either, but then I just came across this? Looks like pro 1.1 is available? https:

I didnt' think so either, but then I just came across this? Looks like pro 1.1 is available?
https://civitai.com/models/618692?modelVersionId=922358

FFurkan Gözükara SECourses yes my config same as on patreon nothing different 😄 same as kohya one

dxqb•10/6/24, 8:20 PM

since we are looking for a specific problem I'd prefer to have original data. config file + image files. DM

EEyeSpyBekoAI I didnt' think so either, but then I just came across this? Looks like pro 1.1 i...

Furkan Gözükara SECourses•10/6/24, 8:21 PM

i think only inference via api

Ddxqb since we are looking for a specific problem I'd prefer to have original data. c...

Furkan Gözükara SECourses•10/6/24, 8:21 PM

sure sending dm

FFurkan Gözükara SECourses both fast and good on 24 gb gpus

B0nd•10/6/24, 8:23 PM

whats the minium steps needed you think for training 40 images, for true photorealism?

BB0nd whats the minium steps needed you think for training 40 images, for true photore...

Furkan Gözükara SECourses•10/6/24, 8:23 PM

lets say 100 epoch for good resemblance

Furkan Gözükara SECourses•10/6/24, 8:23 PM

4000 steps batch size 1

FFurkan Gözükara SECourses 4000 steps batch size 1

B0nd•10/6/24, 8:24 PM

great thanks

Furkan Gözükara SECourses•10/6/24, 8:25 PM

i will update batch size 1 fine tuning configs

Furkan Gözükara SECourses•10/6/24, 8:25 PM

for latest kohya

B0nd•10/6/24, 8:31 PM

when training lora did you notice much difference between adafactor and adamw8bit?

BB0nd when training lora did you notice much difference between adafactor and adamw8bi...

Furkan Gözükara SECourses•10/6/24, 8:32 PM

i plan to investigate

Furkan Gözükara SECourses•10/6/24, 8:32 PM

newest optimizers hopefully soon

Furkan Gözükara SECourses•10/6/24, 8:32 PM

but each one would require different parameters

Furkan Gözükara SECourses•10/6/24, 8:45 PM

hahaha 4765 MB can do flux fine tuning now :d

FFurkan Gözükara SECourses hahaha 4765 MB can do flux fine tuning now :d

crystalwizard•10/6/24, 8:46 PM

except it cant. you know what dpo is?

Ccrystalwizard except it cant. you know what dpo is?

Furkan Gözükara SECourses•10/6/24, 8:47 PM

it is i am doing right now. for single concept it will work perfect

crystalwizard•10/6/24, 8:47 PM

you can't fine tune, or train, flux. you are just creating something that gives you an image but you're not updating the weights or training the model, Doctor

Ccrystalwizard you can't fine tune, or train, flux. you are just creating something that gives ...

Furkan Gözükara SECourses•10/6/24, 8:49 PM

if i am not updating weights of the model it must be magic then

FFurkan Gözükara SECourses if i am not updating weights of the model it must be magic then 😄

crystalwizard•10/6/24, 8:49 PM

i'll ask you again, do you know what DPO is

Ccrystalwizard i'll ask you again, do you know what DPO is

Furkan Gözükara SECourses•10/6/24, 8:50 PM

tell me full words of it

MMaxivi 128x128 and 3e-06

dxqb•10/6/24, 8:50 PM

did you try man or woman

FFurkan Gözükara SECourses tell me full words of it

crystalwizard•10/6/24, 8:50 PM

the paper's on arXIv - i suggest you read it

Ccrystalwizard you can't fine tune, or train, flux. you are just creating something that gives ...

dxqb•10/6/24, 9:01 PM

that's hilarious statement.

dxqb•10/6/24, 9:04 PM

if you know so much about how Flux dev was created, please tell us how exactly the distillation from pro to dev was done, and how DPO was applied (which I'm not doubting - why wouldn't they)

FFurkan Gözükara SECourses ram usage shouldnt be much unless your vram is low

Ereshkigal•10/6/24, 9:11 PM

OK. Just asking cuz I have a 4090 & I've seen upwards of 60GB of system RAM usage when not rendering, when I start a render it goes down (I'm guessing that's loaded on to the gpu).

Ddxqb if you know so much about how Flux dev was created, please tell us how exactly t...

crystalwizard•10/6/24, 9:11 PM

you don't apply dpo to a base model - not if you're smart

dxqb•10/6/24, 9:13 PM

tell us why. DPO is proposed as an alternative to RLHF which obviously was applied very successfully for LLMs

Furkan Gözükara SECourses•10/6/24, 9:19 PM

fine tuning configs for 6 gb, 8gb, 10 gb , 12 gb , 16gb and 24 gb

Furkan Gözükara SECourses•10/6/24, 9:19 PM

Ddxqb tell us why. DPO is proposed as an alternative to RLHF which obviously was appl...

crystalwizard•10/6/24, 9:21 PM

I'll let you go read the paper and think

dxqb•10/6/24, 9:22 PM

so you don't know the answer. alright.

Ddxqb so you don't know the answer. alright.

crystalwizard•10/6/24, 9:37 PM

i do, but i don't feel like hand-feeding you. and you trying to manipulate me into handing you the research you don't want to do isn't going to work

dxqb•10/6/24, 9:38 PM

you are making unsubstantiated claims that you know more about how Flux was created than the general public. anyone can read papers. you have to substantiate your claim.

Ddxqb you are making unsubstantiated claims that you know more about how Flux was crea...

crystalwizard•10/6/24, 9:40 PM

i owe you nothing. i direct you, if you want a place to start your research other than arXiv, to all the posts on this discord ALONE where people talk about how many times they've tried to train flux for something and how it doesn't work. even Furkan himself has expressed issues with that. and that is all i'm giving you for free. go do the research

crystalwizard•10/6/24, 9:40 PM

be just as snarky as you like now, i'm done with you

dxqb•10/6/24, 9:41 PM

blocked

crystalwizard•10/6/24, 9:44 PM

blocking on discord is funny. you still see that the other person has posted something, but you can't see what. you can't tell if they're talking about you or not. blocking on discord is a good way to drive yourself crazy. and when you're the one that's tried to start an arguement, and then block the person you were trying to argue with because they wouldn't play your game, that says something about you to everyone watching

B0nd•10/6/24, 9:45 PM

Whats the best upscaler model that allows commercial use?

BB0nd Whats the best upscaler model that allows commercial use?

crystalwizard•10/6/24, 9:45 PM

topaz's models

Ccrystalwizard topaz's models

B0nd•10/6/24, 9:46 PM

can they be intergrated into comfyUI?

BB0nd can they be intergrated into comfyUI?

crystalwizard•10/6/24, 9:47 PM

no. they're propiratory and exclusive to topaz, and not free - but they are the best and you can use the output commercially

Ccrystalwizard no. they're propiratory and exclusive to topaz, and not free - but they are the ...

B0nd•10/6/24, 9:47 PM

yeah its not the output commercially im looking to do. Its for a the backend of a SaaS product.

daroth•10/6/24, 9:53 PM

cmon everyone, be nice to each other

MMaxivi @Dr. Furkan Gözükara have you tried reg images with dreambooth?

dsienra•10/6/24, 9:59 PM

@Dr. Furkan Gözükara you can try flux finetuning with regularization and in the last epochs remove the regularization, may be the model get resemblance at the end but stays more flexible

Ddsienra @Dr. Furkan Gözükara you can try flux finetuning with regularization and in the ...

Furkan Gözükara SECourses•10/6/24, 10:01 PM

it is an idea

Furkan Gözükara SECourses•10/6/24, 10:01 PM

may work

Furkan Gözükara SECourses•10/6/24, 10:02 PM

i am testing each gpu config to get max speed

Furkan Gözükara SECourses•10/6/24, 10:02 PM

man this is taking time

dsienra•10/6/24, 11:41 PM

flux-dev-de-distill is giving this error @kohya_tech is already informed and he said that he will fix it as soon a possible.

Furkan Gözükara SECourses•10/7/24, 12:13 AM

wow batch size 7 way faster than before

I didnt' think so either, but then I just came across this? Looks like pro 1.1 is available? https:

Similar Threads