Software Engineering Courses (SECourses)•17mo ago

Check this out: https://www.reddit.com/r/StableDiffusion/comments/1f523bd/good_flux_loras_can_be_les

Check this out: https://www.reddit.com/r/StableDiffusion/comments/1f523bd/good_flux_loras_can_be_less_than_45mb_128_dim/

From the StableDiffusion community on Reddit: Good Flux LoRAs can b...

Explore this post and more from the StableDiffusion community

�

𝔸𝖨ΞӾOP•8/30/24, 8:10 PM

Pretty interesting, only trained specific layers and the Lora filesize was only 4.5mb lol

�

𝔸𝖨ΞӾOP•8/30/24, 8:13 PM

I wish I understood this more and what tools to use to train the specific layers they mentioned here:

This LoRA was trained on two layers single_transformer_blocks.7.proj_out and single_transformer_blocks.20.proj_out

It is possible to train on blocks.7.proj_outlayer only if you don't want the dataset style transfer, the size depending on the dim can be below 4.5mb (bf16), the model is powerful enough to offer advantages such as single layer training, so let's do that.

A Flux LoRA with 99% face likeness with great flexibility can be as small as 580kb (single layer, dim 16)

nicearoni•8/30/24, 8:13 PM

that's crazy

nicearoni•8/30/24, 8:15 PM

read the thread - no mention of how speed is affected only training on a couple layers

�

𝔸𝖨ΞӾOP•8/30/24, 8:15 PM

I know someone like the Dr. could crack the code I bet lol

Михаил Кислов•8/30/24, 8:29 PM

Google translator.

Hi all! Successfully trained Lora for Flux. But when using it in Forge, it is ignored.

That is, with the same seed there will be the same result both when using Lora and without it. At the same time, in the console you can see that he is loading it.

Has anyone encountered the problem? How to solve it?

nicearoni•8/30/24, 8:38 PM

I need to reinstall because my Forge wasn't giving consistent results either. Then the console started saying something about patching the Loras? I could generate regular flux images okay in Forge but when I try to use my Lora, my 3090's dedicated memory filled and started using shared memory, so a single image was taking minutes to generate, and then it didn't look like the Lora had applied as expected - or as it does in Swarm where my images come out amazing usig Lora's I trained with Doc's configs. So I probably need a fresh reinstall of Forge. I'll test again and let you know.

Maxivi•8/30/24, 9:17 PM

@Dr. Furkan Gözükara do i have to run accelerate config for multi gpu training?

Uuisato Do you happen to know why there's little to no improvement when using Torch 2.5?...

Furkan Gözükara SECourses•8/30/24, 10:15 PM

it doesnt improve when using single layers methods sadly. but it improved when i was using 18 gb config

Uuisato Also, does anybody have a Comfy workflow for FLUX + LORAs optimized for RTX 3090...

Furkan Gözükara SECourses•8/30/24, 10:15 PM

yes so wrong

Furkan Gözükara SECourses•8/30/24, 10:15 PM

swarmui way faster

�𝔸𝖨ΞӾ Check this out: https://www.reddit.com/r/StableDiffusion/comments/1f523bd/good_f...

Furkan Gözükara SECourses•8/30/24, 10:16 PM

i will look for this i think kohya can add

Furkan Gözükara SECourses•8/30/24, 10:16 PM

also model probably knows that person face very well already

�𝔸𝖨ΞӾ Check this out: https://www.reddit.com/r/StableDiffusion/comments/1f523bd/good_f...

Furkan Gözükara SECourses•8/30/24, 10:23 PM

just replied this to kohya

Furkan Gözükara SECourses•8/30/24, 10:23 PM

cant wait to test it

MMaxivi @Dr. Furkan Gözükara do i have to run accelerate config for multi gpu training?

Furkan Gözükara SECourses•8/30/24, 10:23 PM

yes

Furkan Gözükara SECourses•8/30/24, 10:23 PM

we set it

Furkan Gözükara SECourses•8/30/24, 10:23 PM

i recorded the video

Furkan Gözükara SECourses•8/30/24, 10:23 PM

need to edit and publish

vp•8/30/24, 10:49 PM

he's awake

vp•8/30/24, 10:53 PM

Doc, when you get a chance, and it's not urgent, but I think the windows version of Instant ID gradio is currently broken. Likely do to a change in a package preventing non-safetensor files from running. Error is: "An error occurred while trying to fetch thibaud/controlnet-openpose-sdxl-1.0: thibaud/controlnet-openpose-sdxl-1.0 does not appear to have a file named diffusion_pytorch_model.safetensors.
Defaulting to unsafe serialization. Pass allow_pickle=Falseallow_pickle=False to raise an error instead."

vp•8/30/24, 10:53 PM

thibaud does not have a safetensors version, i think only bin

FFurkan Gözükara SECourses nice let me know

dsienra•8/30/24, 11:03 PM

good news, with TE lr 9e-4 prompting "myname photo" triggers my photo its actually learning the token associated with me, I'm using regularization images from the class person, and my face is not bleeding to other men.

dsienra•8/30/24, 11:03 PM

is still training

dsienra•8/30/24, 11:05 PM

to accelerate the tests I increased the unet lr to 1e-4

dsienra•8/30/24, 11:08 PM

my gol is find a configuration to train multiple people on the same lora avoiding class bleeding and bleeding between the trained subjects

Vvp Doc, when you get a chance, and it's not urgent, but I think the windows version...

Furkan Gözükara SECourses•8/30/24, 11:10 PM

instant id works but i think that error occurs

Furkan Gözükara SECourses•8/30/24, 11:10 PM

i need to check if it affects

Ddsienra good news, with TE lr 9e-4 prompting "myname photo" triggers my photo its actual...

Furkan Gözükara SECourses•8/30/24, 11:10 PM

nice tests

Théo•8/30/24, 11:15 PM

im confuse about something, is it better to train the lora on flux with 1024x picture or higher ? because in your Patreon it says "better resolution is better result, not lower that 1024"

TThéo im confuse about something, is it better to train the lora on flux with 1024x pi...

Furkan Gözükara SECourses•8/30/24, 11:15 PM

higher res yields better true

Furkan Gözükara SECourses•8/30/24, 11:15 PM

if you can afford to wait

Furkan Gözükara SECourses•8/30/24, 11:15 PM

train 1280 x 1280

Théo•8/30/24, 11:16 PM

Oh boi, i was thinking about training 4K pictures, but i suppose even with a 4090 it will take me days hahaha

Furkan Gözükara SECourses•8/30/24, 11:16 PM

by the way after 1536 i didnt test

Furkan Gözükara SECourses•8/30/24, 11:16 PM

i trained max 1536x1536

FFurkan Gözükara SECourses nice tests

dsienra•8/30/24, 11:20 PM

I'm using my actual name "Diego" I didn't try with a unique token that are not present on T5, idk if this is good or bad, I suppose that weird tokens like ohwx are not present on T5 or it contains unique combinations of letters? that the token is present on both text encoders is good or bad for training a new concept?