Software Engineering Courses (SECourses)•15mo ago

Just out of curiosity, approximately how many steps was the checkpoint used for this image trained f

Just out of curiosity, approximately how many steps was the checkpoint used for this image trained for? I'm just curious because for me even at around 2000 steps I'm still getting PlayStation2 CGI type looks even though I'm using real photos as a dataset (50 images). It starts to improve at much higher steps.

EError-404-unknown Just out of curiosity, approximately how many steps was the checkpoint used for ...

Furkan Gözükara SECourses•10/8/24, 10:15 AM

let me check

Furkan Gözükara SECourses•10/8/24, 10:16 AM

it is 140 epoch but since batch size 7 it is not divisible

Furkan Gözükara SECourses•10/8/24, 10:16 AM

so it is actually

Furkan Gözükara SECourses•10/8/24, 10:17 AM

420 steps

Furkan Gözükara SECourses•10/8/24, 10:17 AM

with batch size 7

Furkan Gözükara SECourses•10/8/24, 10:17 AM

so 2920 steps with batch size 1

B0nd•10/8/24, 10:48 AM

Any advice for training loras on flux at 512? its struggling to capture likeness

Dazzastrous [4090]•10/8/24, 10:48 AM

dont

mikemenders•10/8/24, 10:50 AM

I'm looking at the Flux licenses, and as far as I can see, only the schnell version is free for commercial use. The dev version can only be used for non-commercial purposes, or must be agreed separately with BFL. I wonder about that, the SDXL license is a bit more flexible since the change.

CNOC•10/8/24, 10:54 AM

Do you mean 512x512 input images? I've done 2 for curiosities sake and both worked fine using the rank 4 config. I stopped them both around 80 epoch and they were adequate by that stage. One was 9 images, the other 16 or so. Are your input images any good?

B0nd•10/8/24, 11:09 AM

I get insane results at 1024x1024 but the training time is slow and the file size is large. I'm trying to find the lowest I can push the Lora training parameters until details and likeness begin to drop off. As I want to build an app and do this at scale.

CNOC•10/8/24, 11:19 AM

i redid those experiments at 1024 as the 512 was just for the much faster speed and my curiosity, the likeness was fine just not as consistently accurate as the 1024. I didn't tinker with them long or do any overly useful comparisons, I purged the 512 loras and redid them. I did find they seemed more consistent when generating images at 512 also, so if your use case is aiming for that maybe its worth the effort to investigate. Rank 4 config was what I used with some barrel scraping input images id prepped for 1024 and resized to 512 and I was blown away with how well it did, better than any SDXL training and the input images were questionable at best

Kallamamran•10/8/24, 12:36 PM

WTAF... XlabsSampler only generates black images suddenly

Kallamamran•10/8/24, 12:36 PM

This is just a quick workflow to try it out, but it doesn't work

Kallamamran•10/8/24, 12:36 PM

You see anything wrong here?

fadounav•10/8/24, 3:19 PM

@Dr. Furkan Gözükara hellow, i saw there was an update on patreon about fine tune/dreambooth, so can we work on it already?

BB0nd Any advice for training loras on flux at 512? its struggling to capture likeness

PixelMonkey•10/8/24, 3:45 PM

Might be the prompt as well? I did the mistake adding man into my prompt when i wanted to replicate myself.. so instead of "ohwx man" just use your token.. in my case "ohwx" ..

Vigilence•10/8/24, 6:16 PM

Anyone fine tune an fp8 version of flux with 24gb and no shared gpu?

dsienra•10/8/24, 6:17 PM

@Dr. Furkan Gözükara My first test was a total success, I trained many people at the same time without bleeding between each other, It works perfect and the lora can be used on regular flux dev that is much faster on inference, I get a little bleeding with two subjects with a similar name "Diego man" "Dani man" is minimal so it can be fixed changing the name to "Daniel man" I saw a little class bleeding but I think it can be fixed using regularization images. the model behaves very similar to regular SDXL, Training many subjects at the same time was imposible with regular flux-dev. The model is still a little undertrained so I will continue and try with regularization of class people because my dataset contains people from different genders and ages. my captions are very simple, "name class"
This model is awesome and very promising so far.

https://huggingface.co/nyanko7/flux-dev-de-distill

nyanko7/flux-dev-de-distill · Hugging Face

dsienra•10/8/24, 6:22 PM

note: for this first test I used 512x512 resolution to speed up the training and I used a higher lr for the same reason 0.0001 for unet and TE, may be with lower lr and of couse at 1024x1024 will get better results

BB0nd Any advice for training loras on flux at 512? its struggling to capture likeness

Furkan Gözükara SECourses•10/8/24, 9:25 PM

512 reduces likeliness

B0nd•10/8/24, 9:25 PM

Yeah I’ve figured

Mmikemenders I'm looking at the Flux licenses, and as far as I can see, only the schnell vers...

Furkan Gözükara SECourses•10/8/24, 9:25 PM

SDXL is free to use afaik

Ffadounav @Dr. Furkan Gözükara hellow, i saw there was an update on patreon about fine tu...

Furkan Gözükara SECourses•10/8/24, 9:25 PM

yep

VVigilence Anyone fine tune an fp8 version of flux with 24gb and no shared gpu?

Furkan Gözükara SECourses•10/8/24, 9:25 PM

fp8 fine tuning not supported

Furkan Gözükara SECourses•10/8/24, 9:26 PM

i asked kohya he doesnt know how to

Ddsienra @Dr. Furkan Gözükara My first test was a total success, I trained many people at...

Furkan Gözükara SECourses•10/8/24, 9:26 PM

awesome

Furkan Gözükara SECourses•10/8/24, 9:26 PM

they werent in the same picture right?

Furkan Gözükara SECourses•10/8/24, 9:26 PM

seperate images

Furkan Gözükara SECourses•10/8/24, 9:27 PM

10 epoch 256 images batch size 7

Furkan Gözükara SECourses•10/8/24, 9:27 PM

takes 2:58:25 on single RTX A6000

Furkan Gözükara SECourses•10/8/24, 9:28 PM

30 epoch

Furkan Gözükara SECourses•10/8/24, 10:30 PM

i like the shading / shadow on head from moonlight epic

Furkan Gözükara SECourses•10/8/24, 10:31 PM

and this is 100 epoch clearly overfit

Furkan Gözükara SECourses•10/8/24, 10:33 PM

here a good example of undertrained to overfit for you . i think epoch 40 is best

FFurkan Gözükara SECourses they werent in the same picture right?

dsienra•10/8/24, 11:32 PM

yes different images, but sdxl has the same problem to generate two different people in the same image, the good thing is that now I can train multiple subjects in one lora, I didn't try to generate two people in the same frame, I will try tomorrow

Ddsienra @Dr. Furkan Gözükara My first test was a total success, I trained many people at...

OinkSauce•10/9/24, 5:10 AM

Are you doing a fine-tune then extracting a LORA? or is this a straight LORA training?
I've been training finetunes/loras on family members, so having a bunch of subjects together with lower bleeding is a great use case for me. Even if there is still some bleeding, then I can segment or inpaint the faces if it can get the broad features correct.

KGTachi•10/9/24, 5:40 AM

@Dr. Furkan Gözükara did you have any success with the one trainer anti bleed thing ?

Vinch•10/9/24, 8:47 AM

I bought 2x used 3090 on the cheap. But I keep getting blue screens If I want to use both of them optimally. Please don't tell me that I have to upgrade my PSU as well

Papst•10/9/24, 9:12 AM

How do I use the new koya dreambooth training files in swamp?

Papst•10/9/24, 9:12 AM

I get an error when loading it backend #0 failed to load model test_1-000150.safetensors

CNOC•10/9/24, 9:32 AM

Note sure if this applies but if youre on massedcompute you need to copy model/clip/vae files into relevant swarm folders. Your checkpoint will go in diffussion_models, or the lora folder if that is what you trained in which case flux1_dev needs to be in diffusion_models