Software Engineering Courses (SECourses)•9mo ago

<@205854764540362752>it's working，thank you a lot ，this app will help me a lot，

@Furkan Gözükara SECoursesit's working，thank you a lot ，this app will help me a lot，

Kkey111 <@205854764540362752>it's working，thank you a lot ，this app will help me a lot，

Furkan Gözükara SECourses•4/16/25, 9:33 AM

great

Eeko Ah, even though it is the same model, HuggingFace expects a directory structure ...

Furkan Gözükara SECourses•4/16/25, 9:33 AM

you need to look for single file load if you want to use genreated checkpoints

Original message was deleted

Furkan Gözükara SECourses•4/16/25, 2:36 PM

make all 8e-06

Original message was deleted

Furkan Gözükara SECourses•4/16/25, 2:47 PM

i had updated the config

Furkan Gözükara SECourses•4/16/25, 2:47 PM

after new tests

vaibhav•4/16/25, 4:26 PM

I need some help. I trained a flux LoRA with highest training.
So the text encoder was tuned as well.

When i place the text encoder in the SwarmUI/Models/clip path. It re-downloads with the name t5xxl_enconly.

I have this t5xxl_fp16.safetensors with me which presumably got tuned.

Everything else is fine. I am doing something wrong here with t5.
I donloaded models from this HF Repo. "OwlMaster/FLUX_LoRA_Train"

Any help would be great. I am on a cloud VM and banging my head for this.

vaibhav•4/16/25, 4:36 PM

I have found some advice. Aggressive learning rate with aggresive gradient clipping. Converges way faster they say.

John Cena•4/16/25, 4:49 PM

Looking to finetune a model for style, and i was wondering if anyone knows anywhere I can learn about the process. I.e how to prepare dataset, what is sufficient amount of training data, what model to use etc. I'm super new to this and would really appreciate any advice or pointers. Thank you !!

John Cena•4/16/25, 4:50 PM

If it would help to provide examples of the style I'm going for, I would be happy to share

Vvaibhav I need some help. I trained a flux LoRA with highest training. So the text encod...

Furkan Gözükara SECourses•4/16/25, 6:08 PM

you have to rename T5 to same name as swarmui uses

Furkan Gözükara SECourses•4/16/25, 6:08 PM

to prevent download

JJohn Cena Looking to finetune a model for style, and i was wondering if anyone knows anywh...

Furkan Gözükara SECourses•4/16/25, 6:08 PM

i have it

Furkan Gözükara SECourses•4/16/25, 6:09 PM

https://huggingface.co/MonsterMMORPG/3D-Cartoon-Style-FLUX

MonsterMMORPG/3D-Cartoon-Style-FLUX · Hugging Face

Furkan Gözükara SECourses•4/16/25, 6:09 PM

read carefully

John Cena•4/16/25, 7:48 PM

If I'm using a synthetic dataset,will it bake the artifacts into the style?

Konstantin•4/16/25, 7:53 PM

I'm trying to train Dreambooth flux on 29 images + regularization. Now 25 epochs have passed and the proximity to the target face is zero... Should I wait further hoping that by the 100th epoch everything will get better or is something interfering with training and I shouldn't try further?
I use kohya-ss

JJohn Cena If I'm using a synthetic dataset,will it bake the artifacts into the style?

Furkan Gözükara SECourses•4/16/25, 10:24 PM

yep

KKonstantin I'm trying to train Dreambooth flux on 29 images + regularization. Now 25 epochs...

Furkan Gözükara SECourses•4/16/25, 10:25 PM

i would say something sounds broken

Furkan Gözükara SECourses•4/16/25, 10:25 PM

which config you are using?

Konstantin•4/16/25, 10:30 PM

I'm trying Adagrad. 20 blocks swap, which is strange for me VRAM is enough for 18 blocks, but it works slower (8 sec/step at 20 blocks and 10 at 18 blocks). Lr = 1e-5. I don't train the text encoder (I don't know if it's necessary, it's not entirely clear to me how it works when there is already T5). I use regularization and it feels like it rolls back the training...

Konstantin•4/16/25, 10:31 PM

I also use the fp8 model as a base and the T5 is also fp8

KKonstantin I also use the fp8 model as a base and the T5 is also fp8

Furkan Gözükara SECourses•4/16/25, 10:43 PM

is one of my configs?

Konstantin•4/16/25, 10:50 PM

No, I tried to put together general ideas that were found on reddit.

Furkan Gözükara SECourses•4/16/25, 10:51 PM

testing grid

Furkan Gözükara SECourses•4/16/25, 10:51 PM

my newest training for a client i think worked perfect

Konstantin•4/16/25, 10:54 PM

I'm also wondering why "accelerate" isn't updated in kohya_ss scripts. As I understand, newer versions allow using fp8 weights during training. Or am I wrong?

Original message was deleted

Furkan Gözükara SECourses•4/16/25, 10:58 PM

well masked training causes body disproportions

KKonstantin I'm also wondering why "accelerate" isn't updated in kohya_ss scripts. As I unde...

Furkan Gözükara SECourses•4/16/25, 10:59 PM

accelerate working fine i think

Original message was deleted

Furkan Gözükara SECourses•4/16/25, 11:01 PM

well when i describe background good enough it usually works

Furkan Gözükara SECourses•4/16/25, 11:01 PM

during inference

Original message was deleted

Furkan Gözükara SECourses•4/16/25, 11:04 PM

i still prefer just ohwx man

Furkan Gözükara SECourses•4/16/25, 11:04 PM

or woman

FFurkan Gözükara SECourses yep

John Cena•4/17/25, 1:44 AM

Is there any way to get around that?

JJohn Cena Is there any way to get around that?

Furkan Gözükara SECourses•4/17/25, 1:59 AM

not that i know

Konstantin•4/17/25, 7:48 AM

Hmm, without regularization with the same settings it turned out very well, from the 10th epoch the features were slightly visible, by 40 it was already very similar. Now the 90th epoch is underway, I don't see any overfitting yet.
This raises the question of why regularization complicates the process so much... Or is it all because my batch size and step accumulation are set to 1? Does it learn on 1 gradient and roll itself back when it hits regularization?

Konstantin•4/17/25, 7:59 AM

So should de-distill flux models work better with regularization? Or should the gradient update always contain at least one target image when regularizing so as not to forget it?

Konstantin•4/17/25, 8:16 AM

I'll probably try to experiment with Flex.1-alpha and de-distill models in fine-grained learning.
And also I wonder if fine-grained learning with block freezing will work? That is, if I, for example, train a fine model on 4 doubles and 4 singles (or any other configuration), then later, when extracting Lora of rank 256, I can remove all layers except those that were trained, getting a more compact lora, right? Or are others that I did not train also important when extracting lora?

Original message was deleted

Furkan Gözükara SECourses•4/17/25, 3:46 PM

which guide did you watch?

Original message was deleted

Furkan Gözükara SECourses•4/17/25, 3:48 PM

ye this is for sdxl

Furkan Gözükara SECourses•4/17/25, 3:48 PM

what you want to train?

Original message was deleted

Furkan Gözükara SECourses•4/17/25, 3:49 PM

ok then use flux

Furkan Gözükara SECourses•4/17/25, 3:49 PM

https://youtu.be/FvpWy1x5etM

YouTubeSECourses

FLUX Full Fine-Tuning / DreamBooth Training Master Tutorial for Win...

If you want to train FLUX with maximum possible quality, this is the tutorial looking for. In this comprehensive tutorial, you will learn how to install Kohya GUI and use it to fully Fine-Tune / DreamBooth FLUX model. After that how to use SwarmUI to compare generated checkpoints / models and find the very best one to generate most amazing image...

Original message was deleted

Furkan Gözükara SECourses•4/17/25, 3:52 PM

for sdxl

Furkan Gözükara SECourses•4/17/25, 3:52 PM

we use reg images

Furkan Gözükara SECourses•4/17/25, 3:52 PM

to use max reg images you need to use repeating and do 1 epoch

Furkan Gözükara SECourses•4/17/25, 3:52 PM

onetrainer better for sdxl

Furkan Gözükara SECourses•4/17/25, 3:52 PM

watch its tutorial

Furkan Gözükara SECourses•4/17/25, 3:52 PM

https://youtu.be/0t5l6CP9eBg

YouTubeSECourses

Full Stable Diffusion SD & XL Fine Tuning Tutorial With OneTrainer ...

In this tutorial, I am going to show you how to install OneTrainer from scratch on your computer and do a Stable Diffusion SDXL (Full Fine-Tuning 10.3 GB VRAM) and SD 1.5 (Full Fine-Tuning 7GB VRAM) based models training on your computer and also do the same training on a very cheap cloud machine from MassedCompute if you don't have such compute...

TrumpYouAll•4/18/25, 4:42 PM

@Furkan Gözükara SECourses IS there any guidance / video from you to teach us how to train Lora for Wan 2.1 ?

�

🍭🎀 𝒜𝓋𝒶 𝐹𝓇𝒾𝑔𝑔 🎀🍭•4/18/25, 8:36 PM

Guys, could a person with tattoo be trained and the Tattoos be reproduced correctly? Would sdxl be able to do that too? Fine tuning @Furkan Gözükara SECourses

<@205854764540362752>it's working，thank you a lot ，this app will help me a lot，

Similar Threads