Software Engineering Courses (SECourses)•17mo ago

Also, does anybody have a Comfy workflow for FLUX + LORAs optimized for RTX 3090? I'm getting 15.79s

Also, does anybody have a Comfy workflow for FLUX + LORAs optimized for RTX 3090? I'm getting 15.79s/it, which strikes me as there's something wrong with my workflow/configuration.

uisatoOP•8/30/24, 6:01 PM

Using this one.

MarkuryFLUX_LoRA_v2_-_FLUX__LORA.json17.59KB

DDreamer@TDFilmStudio since you trained on 512X512 dataset, will your outputs be affected if you go fo...

nicearoni•8/30/24, 6:02 PM

all of these outputs were 1024x1024 so I don't think so? I'll try some higher resolutions now

Nnicearoni all of these outputs were 1024x1024 so I don't think so? I'll try some higher re...

Dreamer@TDFilmStudio•8/30/24, 6:05 PM

Thanks for sharing your findings. I finished with my first character Flux Lora training today. I want to try out product lora next. Do you think it would be different from your style lora experiment? Why did you remove the word style from the target trained folder name? Does that impact the final quality?

DDreamer@TDFilmStudio Thanks for sharing your findings. I finished with my first character Flux Lora t...

nicearoni•8/30/24, 6:10 PM

I removed it from the Class prompt textbox in the kohya GUI as well after I clicked 'prepare training data' and 'copy info to respective fields' and renamed the folder (not sure that textbox is used outside of preparing\copying, just wanted to be sure). I removed it because of the convos around here about training on just 'ohwx' instead of 'ohwx man'. In comparing the 25 epoch from both trainings I did, I preferred the second one that only had the instance prompt and no captions.

Nnicearoni I removed it from the Class prompt textbox in the kohya GUI as well after I clic...

Dreamer@TDFilmStudio•8/30/24, 6:11 PM

Thats really interesting. Also reduces the prep steps. Captioning is tedious job

Uuisato Also, does anybody have a Comfy workflow for FLUX + LORAs optimized for RTX 3090...

nicearoni•8/30/24, 6:13 PM

yeah that def seems high... here's what I'm getting in SwarmUI (which of course uses Comfy as its backend) for 30 steps per 1024x1024 image in Swarm with a 2GB LoRA I trained myself...

DDreamer@TDFilmStudio Thats really interesting. Also reduces the prep steps. Captioning is tedious job

nicearoni•8/30/24, 6:15 PM

definitely agree on captioning being tedious! I decided to try without after hearing some people say it didn't help or even hurt character likeness, and that flux apparently has its own internal captioning somehow when training?

Dreamer@TDFilmStudio•8/30/24, 6:17 PM

Sharing my first batch of flux lora.

message.txt8.82KB

DDreamer@TDFilmStudio Sharing my first batch of flux lora.

nicearoni•8/30/24, 6:19 PM

dude these are

!! thanks for sharing - how many pics in your training dataset and how many training steps?

Nnicearoni dude these are 🔥 !! thanks for sharing - how many pics in your training dataset...

Dreamer@TDFilmStudio•8/30/24, 6:21 PM

Thanks. I had 16 pics. Rest of the configs I just imported Doc's 'rank 3' slow version

Dreamer@TDFilmStudio•8/30/24, 6:21 PM

Still let me confirm

Nnicearoni dude these are 🔥 !! thanks for sharing - how many pics in your training dataset...

Dreamer@TDFilmStudio•8/30/24, 6:27 PM

I think 16 pics gave me 3200 steps, took a little less than 4 hours with 1024X1024 max resolution for my base images on my 4090

Uuisato Using this one.

uisatoOP•8/30/24, 7:41 PM

Solved it! Had to update NVIDIA drivers and turnoff shared memory. Turned on the --normalvram argument on Comfy. Getting 3.2 it/s

3090-is-really-slow-at-flux-standart-comfyui-workflow-v0-1wog5nzpskid1.webp

daroth•8/30/24, 7:44 PM

for generating with Flux, do you guys use Forge WebUI or ComfyUI?

Ddaroth for generating with Flux, do you guys use Forge WebUI or ComfyUI?

J2_Nedo•8/30/24, 7:45 PM

Forge and SwarmUI

J2_Nedo•8/30/24, 7:45 PM

SwarmUI is missing in your List

daroth•8/30/24, 7:47 PM

substitue it with other

daroth•8/30/24, 7:55 PM

�

𝔸𝖨ΞӾ•8/30/24, 8:10 PM

Check this out: https://www.reddit.com/r/StableDiffusion/comments/1f523bd/good_flux_loras_can_be_less_than_45mb_128_dim/

From the StableDiffusion community on Reddit: Good Flux LoRAs can b...

Explore this post and more from the StableDiffusion community

�

𝔸𝖨ΞӾ•8/30/24, 8:10 PM

Pretty interesting, only trained specific layers and the Lora filesize was only 4.5mb lol

�

𝔸𝖨ΞӾ•8/30/24, 8:13 PM

I wish I understood this more and what tools to use to train the specific layers they mentioned here:

This LoRA was trained on two layers single_transformer_blocks.7.proj_out and single_transformer_blocks.20.proj_out

It is possible to train on blocks.7.proj_outlayer only if you don't want the dataset style transfer, the size depending on the dim can be below 4.5mb (bf16), the model is powerful enough to offer advantages such as single layer training, so let's do that.

A Flux LoRA with 99% face likeness with great flexibility can be as small as 580kb (single layer, dim 16)

nicearoni•8/30/24, 8:13 PM

that's crazy

nicearoni•8/30/24, 8:15 PM

read the thread - no mention of how speed is affected only training on a couple layers

�

𝔸𝖨ΞӾ•8/30/24, 8:15 PM

I know someone like the Dr. could crack the code I bet lol

Михаил Кислов•8/30/24, 8:29 PM

Google translator.

Hi all! Successfully trained Lora for Flux. But when using it in Forge, it is ignored.

That is, with the same seed there will be the same result both when using Lora and without it. At the same time, in the console you can see that he is loading it.

Has anyone encountered the problem? How to solve it?

nicearoni•8/30/24, 8:38 PM

I need to reinstall because my Forge wasn't giving consistent results either. Then the console started saying something about patching the Loras? I could generate regular flux images okay in Forge but when I try to use my Lora, my 3090's dedicated memory filled and started using shared memory, so a single image was taking minutes to generate, and then it didn't look like the Lora had applied as expected - or as it does in Swarm where my images come out amazing usig Lora's I trained with Doc's configs. So I probably need a fresh reinstall of Forge. I'll test again and let you know.

Maxivi•8/30/24, 9:17 PM

@Dr. Furkan Gözükara do i have to run accelerate config for multi gpu training?

Uuisato Do you happen to know why there's little to no improvement when using Torch 2.5?...

Furkan Gözükara SECourses•8/30/24, 10:15 PM

it doesnt improve when using single layers methods sadly. but it improved when i was using 18 gb config

Uuisato Also, does anybody have a Comfy workflow for FLUX + LORAs optimized for RTX 3090...

Furkan Gözükara SECourses•8/30/24, 10:15 PM

yes so wrong

Furkan Gözükara SECourses•8/30/24, 10:15 PM

swarmui way faster

�𝔸𝖨ΞӾ Check this out: https://www.reddit.com/r/StableDiffusion/comments/1f523bd/good_f...

Furkan Gözükara SECourses•8/30/24, 10:16 PM

i will look for this i think kohya can add

Furkan Gözükara SECourses•8/30/24, 10:16 PM

also model probably knows that person face very well already

�𝔸𝖨ΞӾ Check this out: https://www.reddit.com/r/StableDiffusion/comments/1f523bd/good_f...

Furkan Gözükara SECourses•8/30/24, 10:23 PM

just replied this to kohya

Furkan Gözükara SECourses•8/30/24, 10:23 PM

cant wait to test it

MMaxivi @Dr. Furkan Gözükara do i have to run accelerate config for multi gpu training?

Furkan Gözükara SECourses•8/30/24, 10:23 PM

yes

Furkan Gözükara SECourses•8/30/24, 10:23 PM

we set it

Furkan Gözükara SECourses•8/30/24, 10:23 PM

i recorded the video

Furkan Gözükara SECourses•8/30/24, 10:23 PM

need to edit and publish

vp•8/30/24, 10:49 PM

he's awake

vp•8/30/24, 10:53 PM

Doc, when you get a chance, and it's not urgent, but I think the windows version of Instant ID gradio is currently broken. Likely do to a change in a package preventing non-safetensor files from running. Error is: "An error occurred while trying to fetch thibaud/controlnet-openpose-sdxl-1.0: thibaud/controlnet-openpose-sdxl-1.0 does not appear to have a file named diffusion_pytorch_model.safetensors.
Defaulting to unsafe serialization. Pass

allow_pickle=False

allow_pickle=False

to raise an error instead."

vp•8/30/24, 10:53 PM

thibaud does not have a safetensors version, i think only bin

FFurkan Gözükara SECourses nice let me know

dsienra•8/30/24, 11:03 PM

good news, with TE lr 9e-4 prompting "myname photo" triggers my photo its actually learning the token associated with me, I'm using regularization images from the class person, and my face is not bleeding to other men.

dsienra•8/30/24, 11:03 PM

is still training

dsienra•8/30/24, 11:05 PM

to accelerate the tests I increased the unet lr to 1e-4

dsienra•8/30/24, 11:08 PM

my gol is find a configuration to train multiple people on the same lora avoiding class bleeding and bleeding between the trained subjects

Vvp Doc, when you get a chance, and it's not urgent, but I think the windows version...

Furkan Gözükara SECourses•8/30/24, 11:10 PM

instant id works but i think that error occurs

Furkan Gözükara SECourses•8/30/24, 11:10 PM

i need to check if it affects

Ddsienra good news, with TE lr 9e-4 prompting "myname photo" triggers my photo its actual...

Furkan Gözükara SECourses•8/30/24, 11:10 PM

nice tests

Théo•8/30/24, 11:15 PM

im confuse about something, is it better to train the lora on flux with 1024x picture or higher ? because in your Patreon it says "better resolution is better result, not lower that 1024"

TThéo im confuse about something, is it better to train the lora on flux with 1024x pi...

Furkan Gözükara SECourses•8/30/24, 11:15 PM

higher res yields better true

Also, does anybody have a Comfy workflow for FLUX + LORAs optimized for RTX 3090? I'm getting 15.79s

Similar Threads

Similar Threads

Similar Threads