Software Engineering Courses (SECourses)•15mo ago

you cannot train flux1.1, the kohya configs on patreon include a script that will download the flux

you cannot train flux1.1, the kohya configs on patreon include a script that will download the flux dev model and required files, then you can choose to train a lora or do a fine tune and extract a lora or use the fine tune as is in place of flux

Darth Teethius•10/7/24, 7:09 AM

@Dr. Furkan Gözükara im trying the new flux training scripts. Using the json for 12gb (i have a 3060) and im getting a Cuda oom error. My virtual memory is set to 65gb per the patreon description. Any idea what might be wrong?

Darth Teethius•10/7/24, 7:09 AM

Darth Teethius•10/7/24, 7:10 AM

this is the error

DDarth Teethius this is the error

crystalwizard•10/7/24, 7:11 AM

did you search google for that error?

Darth Teethius•10/7/24, 7:13 AM

i searched the cuda out of memory

DDarth Teethius i searched the cuda out of memory

crystalwizard•10/7/24, 7:13 AM

search the "might be complied" message

crystalwizard•10/7/24, 7:13 AM

and make sure you ahve enough paging space

Darth Teethius•10/7/24, 7:14 AM

i have pagefile set at 65gb

Darth Teethius•10/7/24, 7:14 AM

i have that space

Darth Teethius•10/7/24, 7:15 AM

im not seeing the complied error

DDarth Teethius im not seeing the complied error

crystalwizard•10/7/24, 7:16 AM

right under the first out of memory error, look for Cuda kernal errors might be asynchronously reported at some other API call

crystalwizard•10/7/24, 7:16 AM

it's a pretty common cuda error.

Darth Teethius•10/7/24, 7:19 AM

it seems to be --disable-cuda-malloc related

Darth Teethius•10/7/24, 7:19 AM

from what im reading,

Darth Teethius•10/7/24, 7:20 AM

if im getting it right, but im unsure where to insert that

Darth Teethius•10/7/24, 7:20 AM

looks like it goes into the .bat

CCNOC you cannot train flux1.1, the kohya configs on patreon include a script that wil...

liorftw•10/7/24, 7:23 AM

so I need to extract a lora that i like? and then to do a dreambooth training on it?

Darth Teethius•10/7/24, 7:26 AM

say you want to make the best quality lora, you would do a fine tune, then there is a function in kohya that looks at the base file(flux) and your fine tune safetensor and it extracts the difference between them. That becomes your final lora

liorftw•10/7/24, 7:28 AM

Fine tune is to train a dreambooth?

liorftw•10/7/24, 7:29 AM

Sorry I'm just started learning

Darth Teethius•10/7/24, 7:29 AM

yes

liorftw•10/7/24, 7:29 AM

When I train dreambooth I need to train big data set of man pics again with also my pics?

Darth Teethius•10/7/24, 7:30 AM

for flux?

liorftw•10/7/24, 7:30 AM

Yes

liorftw•10/7/24, 7:30 AM

Because I remember that what you needed for sdxl

Darth Teethius•10/7/24, 7:30 AM

no man pics. reg images don't work with flux

liorftw•10/7/24, 7:30 AM

Oh cool

liorftw•10/7/24, 7:31 AM

So Im taking my lora and my dreambooth and doing extraction

liorftw•10/7/24, 7:31 AM

And it will do the best result

CNOCOP•10/7/24, 7:31 AM

you only need to do one or the other

CNOCOP•10/7/24, 7:31 AM

You can train a lora directly, or you can do a finetune and extract a lora which will be better quality

liorftw•10/7/24, 7:32 AM

Ok thank you

liorftw•10/7/24, 7:32 AM

Thank you both

CNOCOP•10/7/24, 7:33 AM

No problem. Are you training locally or on massed compute or something?

liorftw•10/7/24, 7:33 AM

There will be support for 1.1?

Lliorftw There will be support for 1.1?

crystalwizard•10/7/24, 7:34 AM

1.1 is flux pro. flux pro, all versions, are api only

CNOCOP•10/7/24, 7:34 AM

I personally doubt it, I don't see the reason for them releasing it

liorftw•10/7/24, 7:34 AM

I'm doing local with 4090

DDarth Teethius it seems to be --disable-cuda-malloc related

crystalwizard•10/7/24, 7:35 AM

i'm going to suggest you go to the technical support channel on the stable diffusion discord and look for CS1o, and ask him about that. that question comes up in there all the time

Darth Teethius•10/7/24, 7:36 AM

thank you\

liorftw•10/7/24, 7:37 AM

Maybe there is better checkpoints instead of training flux? Like people not fine tune the model to do more realistic? Like sdxl models

CNOCOP•10/7/24, 7:37 AM

If you are doing the fine tune just be aware when it saves checkpoints they are huge, if you are wanting to just tinker around for fun I think a lora is a decent first option. Just get like 15 pics that are half decent and see how it goes

liorftw•10/7/24, 7:38 AM

I already did lora and it did very well

CNOCOP•10/7/24, 7:39 AM

If you are wanting a better checkpoint for the people realism (eg skin) part I think you will likely find that your own training/lora will already address that enough as is probably

liorftw•10/7/24, 7:42 AM

Hmm it interesting

CNOCOP•10/7/24, 7:45 AM

Depends what your goal is of course. Personally I have just trained of dev and have been very happy with the results as far as skin texture etc but im just messing around for fun with friends family so not super picky. The only time I trained something other than dev was when I trained a lora of our old dog using the checkpoint i trained of my wife as using two loras was giving me junk results

liorftw•10/7/24, 7:47 AM

Well I trained on my pics and lot of the pictures doing smooth skins i wondered if it because of of my data set maybe some of the pics has smooth skin filter

liorftw•10/7/24, 7:48 AM

I trained on 33 pics

Lliorftw Well I trained on my pics and lot of the pictures doing smooth skins i wondered ...

crystalwizard•10/7/24, 7:53 AM

the AI is only going to learn what it's taught ...

you cannot train flux1.1, the kohya configs on patreon include a script that will download the flux

Similar Threads

Similar Threads

Similar Threads