Software Engineering Courses (SECourses)•15mo ago

Is it possible to create a finetune, then extract the LORA? I've had good luck with that for single

Is it possible to create a finetune, then extract the LORA? I've had good luck with that for single subjects, and sometimes it's also nice to have a checkpoint as well.

dsienra•10/9/24, 4:57 PM

flux-dev can train only one subject, but with flux-dev-de-distill I can learn many concepts

VVigilence Best gpu prices are from here - https://www.autodl.com/home but I don't know ho...

wardensc2•10/9/24, 4:58 PM

Most of us dont know chinese, oh well

Vigilence•10/9/24, 4:58 PM

@wardensc2 I just use google translate to change the text.

OOinkSauce Is it possible to create a finetune, then extract the LORA? I've had good luck ...

dsienra•10/9/24, 4:59 PM

yes but is too slow... now I'm training on my 3090ti, may be then I will try on mass compute

OinkSauceOP•10/9/24, 4:59 PM

I don't think I've ever tried to train a finetune with more than one subject

VVigilence @wardensc2 I just use google translate to change the text.

wardensc2•10/9/24, 4:59 PM

but when you access to their server, their GUI also chinese, what will you do = )))

Vigilence•10/9/24, 5:00 PM

@wardensc2 Click translate in the browser, lol.

Vigilence•10/9/24, 5:00 PM

Wwardensc2 Since SDXL have instance ID, so I use it for more convenience if I need people l...

dsienra•10/9/24, 5:00 PM

yes but the quality is much worse... now I'm full on flux-dev-de-distill

wardensc2•10/9/24, 5:01 PM

Also @Dr. Furkan Gözükara already set up kohya_ss for quick install on Mass Compute, I just need 1 console code for it to run everything

VVigilence Click to see attachment

wardensc2•10/9/24, 5:01 PM

no this is only the beginning

wardensc2•10/9/24, 5:02 PM

similar to masscompute, you have to upload your image training data and the checkpoint you want to train, vae, clip and install Kohya as well

wardensc2•10/9/24, 5:02 PM

it similar to our local PC but better hardware, it's not one click training.

Ddsienra yes but the quality is much worse... now I'm full on flux-dev-de-distill

wardensc2•10/9/24, 5:04 PM

No I guarantee when it come to people image, install ID is much better than lora if you know how to use it properly

wardensc2•10/9/24, 5:04 PM

I'm not sure I can upload AI image of my instant ID for you to see on discord

wardensc2•10/9/24, 5:05 PM

I make Mbappe Instant ID, not sure SDXL lora can beat it

Wwardensc2 No I guarantee when it come to people image, install ID is much better than lora...

dsienra•10/9/24, 5:05 PM

I know what you mean I try it, but the quality over all is much better on flux

dsienra•10/9/24, 5:06 PM

SDXL is good but not as good

wardensc2•10/9/24, 5:06 PM

of course I dont compare with Flux but SDXL lora can't beat Instant ID

Vigilence•10/9/24, 5:06 PM

@wardensc2 I understand. Im just pointing at the price difference.

NVIDIA L20 / 48GB single precision 59.35 TFLOPS / semi precision 119.5 Tensor TFLOPS ￥ 4.19 / hour

USD is 0.60 an hour.

Vigilence•10/9/24, 5:07 PM

NVIDIA L40 / 48GB single precision 90.5 TFLOPS / semi precision 181.05 Tensor TFLOPS ￥ 4.82 / hour

$0.69 USD

Wwardensc2 of course I dont compare with Flux but SDXL lora can't beat Instant ID

dsienra•10/9/24, 5:08 PM

IDK with a well trained lora you get perfect likeness and more flexibility

VVigilence @wardensc2 I understand. Im just pointing at the price difference. NVIDIA L2...

wardensc2•10/9/24, 5:08 PM

yes I know but when you using it, you can't translate everything if the operating system and other support software are also chinese

Vigilence•10/9/24, 5:08 PM

I see, your saying the whole OS would be in chinese.

dsienra•10/9/24, 5:08 PM

but its ok if works for your purpose

Vigilence•10/9/24, 5:09 PM

Maybe Dr. Can team up with them and have them make an option for flux training preconfigured.

Ddsienra IDK with a well trained lora you get perfect likeness and more flexibility

wardensc2•10/9/24, 5:09 PM

normally I just gen a image with style and pose I want then apply Instant ID on it. SDXL lora can't flexible than this

wardensc2•10/9/24, 5:10 PM

something like this

dsienra•10/9/24, 5:10 PM

looks very good

wardensc2•10/9/24, 5:11 PM

this is SDXL not Flux

OinkSauceOP•10/9/24, 5:11 PM

is instant id coming to flux?

wardensc2•10/9/24, 5:11 PM

more fantasy ways

OOinkSauce is instant id coming to flux?

wardensc2•10/9/24, 5:11 PM

I haven't heard it yet

OinkSauceOP•10/9/24, 5:14 PM

does swarmui support de-distilled?

Vigilence•10/9/24, 5:17 PM

OS commands are still the same, just some text is Chinese.

Vigilence•10/9/24, 5:17 PM

@OinkSauce If its .safetensor or .gguf it should work fine.

OinkSauceOP•10/9/24, 5:18 PM

thanks - just tried it and it inferenced, but gave me essentially a static image. does it have its own vae etc?

VVigilence OS commands are still the same, just some text is Chinese.

wardensc2•10/9/24, 5:19 PM

Well I try to register but it does not have my country phone number, so bye bye

hamuz•10/9/24, 5:19 PM

Hi, does anyone know the difference between de-distilled and the standard flux model? When I tried it, using an RTX 3090, I usually get output with flux in 30 seconds, but with de-distilled it took 120 seconds, and the image quality felt lower compared to the standard flux. I’m referring to the flux dev version

wardensc2•10/9/24, 5:20 PM

it's the model for training only

wardensc2•10/9/24, 5:20 PM

dont bother to generate

Vigilence•10/9/24, 5:20 PM

@wardensc2 What country is missing for you?

wardensc2•10/9/24, 5:20 PM

vietnam

wardensc2•10/9/24, 5:20 PM

= )))

Wwardensc2 it's the model for training only

OinkSauceOP•10/9/24, 5:20 PM

ahhhh

Vigilence•10/9/24, 5:21 PM

Just get someone from the us to get the text code for you.

VVigilence Just get someone from the us to get the text code for you.

wardensc2•10/9/24, 5:21 PM

I can use fake IP but MassCompute is enough for me

Vigilence•10/9/24, 5:21 PM

Does masscompute require a vpn for you?

VVigilence Does masscompute require a vpn for you?

wardensc2•10/9/24, 5:21 PM

I can work straight

Is it possible to create a finetune, then extract the LORA? I've had good luck with that for single

Similar Threads