Software Engineering Courses (SECourses)•15mo ago

does swarmui support de-distilled?

Vigilence•10/9/24, 5:17 PM

OS commands are still the same, just some text is Chinese.

Vigilence•10/9/24, 5:17 PM

@OinkSauce If its .safetensor or .gguf it should work fine.

OinkSauceOP•10/9/24, 5:18 PM

thanks - just tried it and it inferenced, but gave me essentially a static image. does it have its own vae etc?

VVigilence OS commands are still the same, just some text is Chinese.

wardensc2•10/9/24, 5:19 PM

Well I try to register but it does not have my country phone number, so bye bye

hamuz•10/9/24, 5:19 PM

Hi, does anyone know the difference between de-distilled and the standard flux model? When I tried it, using an RTX 3090, I usually get output with flux in 30 seconds, but with de-distilled it took 120 seconds, and the image quality felt lower compared to the standard flux. I’m referring to the flux dev version

wardensc2•10/9/24, 5:20 PM

it's the model for training only

wardensc2•10/9/24, 5:20 PM

dont bother to generate

Vigilence•10/9/24, 5:20 PM

@wardensc2 What country is missing for you?

wardensc2•10/9/24, 5:20 PM

vietnam

wardensc2•10/9/24, 5:20 PM

= )))

Wwardensc2 it's the model for training only

OinkSauceOP•10/9/24, 5:20 PM

ahhhh

Vigilence•10/9/24, 5:21 PM

Just get someone from the us to get the text code for you.

VVigilence Just get someone from the us to get the text code for you.

wardensc2•10/9/24, 5:21 PM

I can use fake IP but MassCompute is enough for me

Vigilence•10/9/24, 5:21 PM

Does masscompute require a vpn for you?

VVigilence Does masscompute require a vpn for you?

wardensc2•10/9/24, 5:21 PM

I can work straight

Wwardensc2 it's the model for training only

hamuz•10/9/24, 5:22 PM

OHH this is great. Is it for LoRA training or fine-tuning? I’ve been away from home for about a week, and I was finally excited to train a flux LoRA this night. Should I train my LoRA with the de-distilled version? By the way, I will be training a style LoRA

Vigilence•10/9/24, 5:22 PM

I doubt this place has ip region lock.

Vigilence•10/9/24, 5:22 PM

@hamuz What model?

Hhamuz OHH this is great. Is it for LoRA training or fine-tuning? I’ve been away from h...

wardensc2•10/9/24, 5:22 PM

Just be patient and let the expert do first. Training is different

wardensc2•10/9/24, 5:23 PM

the model is still pretty new so everyone is experimenting it

wardensc2•10/9/24, 5:23 PM

I dont think we need to rush

hamuz•10/9/24, 5:24 PM

I’ve previously trained a few Stable Diffusion LoRAs for my own work purposes, but this will be my first time training a flux LoRA, so I have some knowledge about training

VVigilence @hamuz What model?

hamuz•10/9/24, 5:25 PM

flux dev

Vigilence•10/9/24, 5:25 PM

But which distilled are you looking at?

Hhamuz I’ve previously trained a few Stable Diffusion LoRAs for my own work purposes, b...

wardensc2•10/9/24, 5:26 PM

just learn to use flux dev to train first dont need to use the de-distilled model for now

VVigilence But which distilled are you looking at?

hamuz•10/9/24, 5:26 PM

I don’t know anything about the de-distilled or distilled version; I just heard about it on Reddit a few days ago, and due to my work, I haven’t had much time to research it. However, I plan to retrain my existing SDXL LoRA as a FLUX LoRA

wardensc2•10/9/24, 5:27 PM

now even the good settings to train of de-distilled model are still experimenting so be patient

OOinkSauce does swarmui support de-distilled?

dsienra•10/9/24, 5:27 PM

idk I use forge and it supports it, but you can use regular flux-dev for inference, de-distilled is slower because it uses real cfg an distilled cfg is disabled

wardensc2•10/9/24, 5:27 PM

for Flux Dev model, the best setting we already have, just use @Dr. Furkan Gözükara file

Vigilence•10/9/24, 5:27 PM

@hamuz I am using this one and enjoy the results. https://medium.com/@zhiwangshi28/why-flux-lora-so-hard-to-train-and-how-to-overcome-it-a0c70bc59eaf

OinkSauceOP•10/9/24, 5:28 PM

It seems like, for now, if you are only training one subject, the dev model is probably your go to.

If you want to try something fancy, creating a full finetune checkpoint then extracting the LORA has given me my best LORA's

Wwardensc2 just learn to use flux dev to train first dont need to use the de-distilled mode...

hamuz•10/9/24, 5:28 PM

Alright, thanks man! I’ll train a few different LoRAs with different settings, and I’ll share my experiences here with you. Maybe after doing enough research and gaining some knowledge, I’ll look into the distilled and de-distilled versions

VVigilence @hamuz I am using this one and enjoy the results. https://medium.com/@zhiwangsh...

wardensc2•10/9/24, 5:28 PM

this one I dont see anything different compare with Flux dev Lora

wardensc2•10/9/24, 5:29 PM

just create different image only

wardensc2•10/9/24, 5:29 PM

People also say the same

Wwardensc2 for Flux Dev model, the best setting we already have, just use @Dr. Furkan Gözük...

hamuz•10/9/24, 5:29 PM

ofcourse I will

Vigilence•10/9/24, 5:29 PM

@wardensc2 You tried both? Which output was more aligned to what you used for data?

VVigilence @wardensc2 You tried both? Which output was more aligned to what you used for d...

wardensc2•10/9/24, 5:29 PM

yes I try both

wardensc2•10/9/24, 5:30 PM

compare 2 loras: Flux and that model

wardensc2•10/9/24, 5:30 PM

just different image only

wardensc2•10/9/24, 5:30 PM

nothing improve

wardensc2•10/9/24, 5:30 PM

people suspect it just some kind of merge checkpoint and pretend something new

hamuz•10/9/24, 5:31 PM

Also, has anyone here rented and used an H100? Is there really a significant speed increase in training? Compared to 4x A100

Vigilence•10/9/24, 5:31 PM

There is also the method that ai toolkit uses to train. Some sort of addon model that is based on schnell. A few other distilled as well.

wardensc2•10/9/24, 5:31 PM

To be more specific I train 2 loras with about 30 images and about 5800 step, result is no improvement

Vigilence•10/9/24, 5:32 PM

Same config?

dsienra•10/9/24, 5:32 PM

flux-dev-de-distill is the best for training I'm very impressed, then you can use the lora on regular Flux-dev any quantization as normal

VVigilence Same config?

wardensc2•10/9/24, 5:32 PM

yes

wardensc2•10/9/24, 5:32 PM

just change the checkpoint only

does swarmui support de-distilled?

Similar Threads

Similar Threads

Similar Threads