Software Engineering Courses (SECourses)•15mo ago

Are you doing a fine-tune then extracting a LORA? or is this a straight LORA training? I've been tra

Are you doing a fine-tune then extracting a LORA? or is this a straight LORA training?
I've been training finetunes/loras on family members, so having a bunch of subjects together with lower bleeding is a great use case for me. Even if there is still some bleeding, then I can segment or inpaint the faces if it can get the broad features correct.

KGTachi•10/9/24, 5:40 AM

@Dr. Furkan Gözükara did you have any success with the one trainer anti bleed thing ?

Vinch•10/9/24, 8:47 AM

I bought 2x used 3090 on the cheap. But I keep getting blue screens If I want to use both of them optimally. Please don't tell me that I have to upgrade my PSU as well

Papst•10/9/24, 9:12 AM

How do I use the new koya dreambooth training files in swamp?

Papst•10/9/24, 9:12 AM

I get an error when loading it backend #0 failed to load model test_1-000150.safetensors

CNOC•10/9/24, 9:32 AM

Note sure if this applies but if youre on massedcompute you need to copy model/clip/vae files into relevant swarm folders. Your checkpoint will go in diffussion_models, or the lora folder if that is what you trained in which case flux1_dev needs to be in diffusion_models

Ddsienra yes different images, but sdxl has the same problem to generate two different pe...

Furkan Gözükara SECourses•10/9/24, 10:05 AM

awesome

KKGTachi @Dr. Furkan Gözükara did you have any success with the one trainer anti bleed th...

Furkan Gözükara SECourses•10/9/24, 10:05 AM

it bled i didnt get success

VVinch I bought 2x used 3090 on the cheap. But I keep getting blue screens If I want to...

Furkan Gözükara SECourses•10/9/24, 10:05 AM

ye you need like 900 watt only for gpus

PPapst I get an error when loading it backend #0 failed to load model test_1-000150.saf...

Furkan Gözükara SECourses•10/9/24, 10:06 AM

put into diffusion_models

CCNOC Note sure if this applies but if youre on massedcompute you need to copy model/c...

Furkan Gözükara SECourses•10/9/24, 10:06 AM

true

Furkan Gözükara SECourses•10/9/24, 10:06 AM

guys if you are discord nitro please boost our server

Furkan Gözükara SECourses•10/9/24, 10:09 AM

Furkan Gözükara SECourses•10/9/24, 10:12 AM

for stylized images

Furkan Gözükara SECourses•10/9/24, 10:12 AM

you get more likeliness with more overfit epoch

Furkan Gözükara SECourses•10/9/24, 10:12 AM

interesting

Furkan Gözükara SECourses•10/9/24, 10:12 AM

Furkan Gözükara SECourses•10/9/24, 10:12 AM

NeonNinjaAstro•10/9/24, 10:32 AM

these are very very good
its captured the essence but also stylised it heavily

daroth•10/9/24, 11:27 AM

is there a cmd arg or setting that can be used so Supir auto-loads a preset? naming the preset default doesn't do it

B0nd•10/9/24, 12:40 PM

Is simpletuner faster than kohya at training?

FFurkan Gözükara SECourses 10 epoch 256 images batch size 7

mayna•10/9/24, 1:13 PM

@Bilel look at this man !

mayna•10/9/24, 1:13 PM

Hello All, is video inpainting a thing now ? can I inpaint any video ? I tried runaway one and Cupcut one but it's not that good for results

B0nd•10/9/24, 1:22 PM

@Dr. Furkan Gözükara How fast does dreambooth Flux fine-tune compared to Lora training? Does it scale well with 4-8 GPUS or H100?

daroth•10/9/24, 1:24 PM

My GOD getting Krita AI Diffusion and SwarmUI to use the same comfyui installation as backend, then have a shared model folder for comfy AND swarmui ANd a1111 webui has been the most frustrating two day troubleshooting nightmare I've had in years

OOinkSauce Are you doing a fine-tune then extracting a LORA? or is this a straight LORA tra...

dsienra•10/9/24, 2:25 PM

this a straight LORA training, this is my first test with the model flux-dev-de-distill, works much better than regular flux-dev for training, the only problem is the samples during training, don work correctly with this model because it uses distilled cfg and no regular cfg, but it doesn't interfere with the trainig.

OinkSauceOP•10/9/24, 2:27 PM

Interesting, so you do need to use a reference set.

OOinkSauce Interesting, so you do need to use a reference set.

dsienra•10/9/24, 2:29 PM

What you mean? can you explain further?

OinkSauceOP•10/9/24, 2:30 PM

oh, sorry I misunderstood. I see what you mean, when it generates samples from the lora for each x epoch, those aren't working correctly, so you don't see the progress?

dsienra•10/9/24, 2:34 PM

yes, it generates images but look deformed because it uses real cfg 1, to display correctly you need the cfg at 3.5, the Distilled CFG Scale is disabled on this model so this parameter does nothing

OinkSauceOP•10/9/24, 2:40 PM

Wonder how it actually trains in this case - how it measures the delta between the learning set and the generated results etc.

Elwii•10/9/24, 2:41 PM

Hello I attempted Flux Dreambooth Finetune but ran out of RAM. It filled up and then crashed saying out of memory. I have seen this issue in the channel a few times already but never found a solution. (My System: RTX 3060 12GB, 32 GB RAM)

On the Patreon post @Dr. Furkan Gözükara said: Set Virtual RAM to 64 GB + Enable Shared VRAM

What exactly do you need to do? A more precise description would be great

Ddsienra this a straight LORA training, this is my first test with the model flux-dev-de-...

wardensc2•10/9/24, 2:50 PM

Do you use regulation images folder to train or use caption or don't use anything ?

EElwii Hello I attempted Flux Dreambooth Finetune but ran out of RAM. It filled up and ...

dsienra•10/9/24, 2:52 PM

dsienra•10/9/24, 2:52 PM

there you set you virtual memory size

dsienra•10/9/24, 2:52 PM

64 GB in you case

Ddsienra Click to see attachment

Elwii•10/9/24, 2:54 PM

Thanks, I already set maximum to 64GB, for the initial I used the old on at around 5GB but this did not resolve the issue

Wwardensc2 Do you use regulation images folder to train or use caption or don't use anythin...

dsienra•10/9/24, 3:04 PM

I did my first test, very promising results, a little undertrained at the moment, at the end I resumed the training with regularization images still no bleeding, now I going to start a new training from scratch 11 people at the same time, family and friends, I going to use regularization images from the class person because I'm training people form different ages and genders the regularization images are captioned I downloaded the dataset including captions a time ago it contains very diverse people from different races and ages from baby to elderly people, male and female. the captions of my subjects are simple "name class" lets see how it behaves

EElwii Thanks, I already set maximum to 64GB, for the initial I used the old on at arou...

dsienra•10/9/24, 3:06 PM

do you have enough free space on the selected disk? you are using the correct preset for your system?

Ddsienra do you have enough free space on the selected disk? you are using the correct pr...

Elwii•10/9/24, 3:09 PM

Yes I have half a TB free space on the M.2 ssd, I downloaded Best_Configs_v5.zip and used the 12GB one (12GB_GPU_10800MB_17.2_second_it_Tier_1.json)

dsienra•10/9/24, 3:11 PM

idk, it should work, lets wait for Dr. Furkan may be he can help

Ddsienra do you have enough free space on the selected disk? you are using the correct pr...

Elwii•10/9/24, 3:11 PM

In task manager my gpu settings say 16Gb total shared gpu-storage, is that correct?

Ddsienra idk, it should work, lets wait for Dr. Furkan may be he can help

Elwii•10/9/24, 3:11 PM

Yes alright thank you

dsienra•10/9/24, 3:12 PM

you welcome

Ddsienra I did my first test, very promising results, a little undertrained at the moment...

wardensc2•10/9/24, 3:19 PM

I try to train myself but before that I need more info. Normally when I train a lora of one person if the background have some people behind, somehow the image of the person I train bleed to the background into the people. So in your theory, by training with open dev flux checkpoint we can eliminate this problem right ?

Vigilence•10/9/24, 3:36 PM

@Dr. Furkan Gözükara Is it possible to train a flux lora or flux finetune from a flux q8 gguf format?

Wwardensc2 I try to train myself but before that I need more info. Normally when I train a ...

dsienra•10/9/24, 3:37 PM

The most important thing and the main difference with this model is that I can train multiple people of the same class without bleeding, with regular flux dev I I trained 3 man for example and the model mixed all the faces together, and on inference prompting for one person returns a mix of all, now the problem is gone with flux-dev-de-distill, it behaves like sdxl but with much better quality. I still experimenting but is very promising so far.

Ddsienra The most important thing and the main difference with this model is that I can t...

wardensc2•10/9/24, 3:43 PM

So that mean 1 lora 3 lora active keyword is possible but can they appear all together in 1 image ? You need to check it

Wwardensc2 So that mean 1 lora 3 lora active keyword is possible but can they appear all to...

dsienra•10/9/24, 3:45 PM

I will check that, give me a minute, I trained 1 lora 11 people

wardensc2•10/9/24, 3:46 PM

thank you so much

Wwardensc2 So that mean 1 lora 3 lora active keyword is possible but can they appear all to...

dsienra•10/9/24, 4:29 PM

One at a time works perfect, two or more people on the same frame loose likeness, can be fixed with inpainting, man and woman works much better, the same problem that sdxl have, but remember my lora is still undertrained, lets see with my new lora... I will start training later, it will take 2 days or more to finish

Are you doing a fine-tune then extracting a LORA? or is this a straight LORA training? I've been tra

Similar Threads