Software Engineering Courses (SECourses)•15mo ago

I’ve previously trained a few Stable Diffusion LoRAs for my own work purposes, but this will be my f

I’ve previously trained a few Stable Diffusion LoRAs for my own work purposes, but this will be my first time training a flux LoRA, so I have some knowledge about training

VVigilence @hamuz What model?

hamuzOP•10/9/24, 5:25 PM

flux dev

Vigilence•10/9/24, 5:25 PM

But which distilled are you looking at?

Hhamuz I’ve previously trained a few Stable Diffusion LoRAs for my own work purposes, b...

wardensc2•10/9/24, 5:26 PM

just learn to use flux dev to train first dont need to use the de-distilled model for now

VVigilence But which distilled are you looking at?

hamuzOP•10/9/24, 5:26 PM

I don’t know anything about the de-distilled or distilled version; I just heard about it on Reddit a few days ago, and due to my work, I haven’t had much time to research it. However, I plan to retrain my existing SDXL LoRA as a FLUX LoRA

wardensc2•10/9/24, 5:27 PM

now even the good settings to train of de-distilled model are still experimenting so be patient

OOinkSauce does swarmui support de-distilled?

dsienra•10/9/24, 5:27 PM

idk I use forge and it supports it, but you can use regular flux-dev for inference, de-distilled is slower because it uses real cfg an distilled cfg is disabled

wardensc2•10/9/24, 5:27 PM

for Flux Dev model, the best setting we already have, just use @Dr. Furkan Gözükara file

Vigilence•10/9/24, 5:27 PM

@hamuz I am using this one and enjoy the results. https://medium.com/@zhiwangshi28/why-flux-lora-so-hard-to-train-and-how-to-overcome-it-a0c70bc59eaf

OinkSauce•10/9/24, 5:28 PM

It seems like, for now, if you are only training one subject, the dev model is probably your go to.

If you want to try something fancy, creating a full finetune checkpoint then extracting the LORA has given me my best LORA's

Wwardensc2 just learn to use flux dev to train first dont need to use the de-distilled mode...

hamuzOP•10/9/24, 5:28 PM

Alright, thanks man! I’ll train a few different LoRAs with different settings, and I’ll share my experiences here with you. Maybe after doing enough research and gaining some knowledge, I’ll look into the distilled and de-distilled versions

VVigilence @hamuz I am using this one and enjoy the results. https://medium.com/@zhiwangsh...

wardensc2•10/9/24, 5:28 PM

this one I dont see anything different compare with Flux dev Lora

wardensc2•10/9/24, 5:29 PM

just create different image only

wardensc2•10/9/24, 5:29 PM

People also say the same

Wwardensc2 for Flux Dev model, the best setting we already have, just use @Dr. Furkan Gözük...

hamuzOP•10/9/24, 5:29 PM

ofcourse I will

Vigilence•10/9/24, 5:29 PM

@wardensc2 You tried both? Which output was more aligned to what you used for data?

VVigilence @wardensc2 You tried both? Which output was more aligned to what you used for d...

wardensc2•10/9/24, 5:29 PM

yes I try both

wardensc2•10/9/24, 5:30 PM

compare 2 loras: Flux and that model

wardensc2•10/9/24, 5:30 PM

just different image only

wardensc2•10/9/24, 5:30 PM

nothing improve

wardensc2•10/9/24, 5:30 PM

people suspect it just some kind of merge checkpoint and pretend something new

hamuzOP•10/9/24, 5:31 PM

Also, has anyone here rented and used an H100? Is there really a significant speed increase in training? Compared to 4x A100

Vigilence•10/9/24, 5:31 PM

There is also the method that ai toolkit uses to train. Some sort of addon model that is based on schnell. A few other distilled as well.

wardensc2•10/9/24, 5:31 PM

To be more specific I train 2 loras with about 30 images and about 5800 step, result is no improvement

Vigilence•10/9/24, 5:32 PM

Same config?

dsienra•10/9/24, 5:32 PM

flux-dev-de-distill is the best for training I'm very impressed, then you can use the lora on regular Flux-dev any quantization as normal

VVigilence Same config?

wardensc2•10/9/24, 5:32 PM

yes

wardensc2•10/9/24, 5:32 PM

just change the checkpoint only

Vigilence•10/9/24, 5:32 PM

Maybe it needs different config since the data is distilled.

dsienra•10/9/24, 5:33 PM

the best option will be to full finetune flux-dev-de-distill and then extract the lora

Vigilence•10/9/24, 5:33 PM

I want to do that, but I doubt my 4090 can do it in a reasonable time.

VVigilence Maybe it needs different config since the data is distilled.

wardensc2•10/9/24, 5:34 PM

do you read the author said

wardensc2•10/9/24, 5:34 PM

he said he finetune with 3 million high quality data

wardensc2•10/9/24, 5:34 PM

I bet he need to have a company like facebook or amazon

wardensc2•10/9/24, 5:34 PM

to do that

wardensc2•10/9/24, 5:34 PM

= )))

wardensc2•10/9/24, 5:35 PM

I dont buy it at all

VVigilence Maybe it needs different config since the data is distilled.

dsienra•10/9/24, 5:35 PM

the config is the same for training, is different for inferring it uses real cfg rather than Distilled CFG Scale so is slower to generate pictures

wardensc2•10/9/24, 5:35 PM

base on how long to train just 30 images for a checkpoint

dsienra•10/9/24, 5:36 PM

for that reason I use the trained lora on regular flux-dev

Vigilence•10/9/24, 5:36 PM

Yeah I would like to extract the lora.

Wwardensc2 he said he finetune with 3 million high quality data

dsienra•10/9/24, 5:37 PM

that model is not de-distilled try this one https://huggingface.co/nyanko7/flux-dev-de-distill

nyanko7/flux-dev-de-distill · Hugging Face

VVigilence Yeah I would like to extract the lora.

wardensc2•10/9/24, 5:37 PM

training checkpoint of flux is require much better hardware than lora, so training a checkpoint then extract a lora is not an efficient way to get a lora. I rather train a lora directly

Vigilence•10/9/24, 5:37 PM

@wardensc2 I tried the 4090 config the Dr. had an it said about 4000 hours for 100 images.

Vigilence•10/9/24, 5:38 PM

96gb ram

VVigilence @wardensc2 I tried the 4090 config the Dr. had an it said about 4000 hours for 1...

wardensc2•10/9/24, 5:38 PM

it's true

Vigilence•10/9/24, 5:38 PM

I had to edit his lora config as well, was too slow.

wardensc2•10/9/24, 5:38 PM

I train an rank 128 lora fp16, I need 4 a6000 with 48gb Vram and nearly 5 hours

wardensc2•10/9/24, 5:38 PM

but I get the best quality lora I ever have

Vigilence•10/9/24, 5:39 PM

I can only do 64 rank since I need to work as well.

Vigilence•10/9/24, 5:39 PM

2.61 s/it

I’ve previously trained a few Stable Diffusion LoRAs for my own work purposes, but this will be my f

Similar Threads

Similar Threads

Similar Threads