Software Engineering Courses (SECourses)•11mo ago

Would it help to also train the text encoder (at 50% unet LR for example) and use T5 attention mask

Would it help to also train the text encoder (at 50% unet LR for example) and use T5 attention mask for dreambooth training just as we do with LoRA training? Has anyone seen any benefits?

FFurkan Gözükara SECourses we already train clip

wardensc2•2/12/25, 2:51 PM

Compare with train checkpoint follow your config, if I extract lora from trained checkpoint, is the extracted lora quality better ?

gio3000.•2/12/25, 3:10 PM

Annybody finetuned a style using image data set of a particular city district? I will start It over a previous finetuned person using dreambooth

DDario Would it help to also train the text encoder (at 50% unet LR for example) and us...

Furkan Gözükara SECourses•2/12/25, 3:28 PM

kohya not supporting

FFurkan Gözükara SECourses kohya not supporting

DarioOP•2/12/25, 3:47 PM

What do you mean? Both parameters can be applied in the koyha UI (dreambooth tab) and the training runs without issues. Do you mean it will cause problems with the final trained models?

DDario What do you mean? Both parameters can be applied in the koyha UI (dreambooth tab...

Furkan Gözükara SECourses•2/12/25, 9:46 PM

kohya doesnt train clip large or t5 when doing fine tuning

Furkan Gözükara SECourses•2/12/25, 9:46 PM

try you will see same speed and vram

FFurkan Gözükara SECourses try you will see same speed and vram

DarioOP•2/13/25, 9:04 AM

Ah I see, thanks for clarifying

DDario Ah I see, thanks for clarifying

Furkan Gözükara SECourses•2/13/25, 11:00 AM

yes i told to add kohya but he still didnt add

FFurkan Gözükara SECourses yes i told to add kohya but he still didnt add 😦

DarioOP•2/13/25, 1:42 PM

Interesting to test when it does get implemented at some point.

DDario Interesting to test when it does get implemented at some point.

Furkan Gözükara SECourses•2/13/25, 2:19 PM

100%

keyser_soze•2/14/25, 5:38 AM

@Furkan Gözükara SECourses Hi sir, we trained the Lora model using a quality Tier 1 config file with 48GB of VRAM.
We generated an AI character with photo grid, cropped, flipped, and upscaled the images. We created a dataset of about 8 images to train the Lora model.
While generating images from Lora, the close-ups have a really good face, but in wide shots, the face becomes pixelated.
Additionally, the face does not closely resemble the training dataset.
I’m attaching the images as well.
brown background image is generated
white background image is dataset

WhatsApp_Image_2025-02-14_at_11.01.31_AM.jpeg

WhatsApp_Image_2025-02-14_at_11.01.14_AM_1.jpeg

WhatsApp_Image_2025-02-14_at_11.01.14_AM.jpeg

Kkeyser_soze <@205854764540362752> Hi sir, we trained the Lora model using a quality Tier 1 ...

TheToday•2/15/25, 12:07 AM

I think the dataset is not good, the same background and clothes in all the photos? Probably the problem is in the dataset

TheToday•2/15/25, 12:08 AM

But I don't know, sometimes these things happen

TheToday•2/15/25, 12:10 AM

How many photos did you train?

TTheToday I think the dataset is not good, the same background and clothes in all the phot...

keyser_soze•2/15/25, 2:26 AM

8 images , actually

keyser_soze•2/15/25, 2:34 AM

Which is the best way to train a AI generated character then

keyser_soze•2/15/25, 2:37 AM

And which is the best way to create a dataset for AI generated character?, I tried multiple things, the consistent is not so good

keyser_soze•2/15/25, 2:57 AM

Can someone help me in this it will be really helpfull

Kkeyser_soze Can someone help me in this it will be really helpfull

�

𝗡𝗶𝘁𝗶𝗻 𝗣𝗮𝗿𝗲𝘃𝗮•2/15/25, 10:51 AM

try creating consistent images with pulid first and then train on them

�𝗡𝗶𝘁𝗶𝗻 𝗣𝗮𝗿𝗲𝘃𝗮 try creating consistent images with pulid first and then train on them

keyser_soze•2/15/25, 10:55 AM

thanks nitin , for your suggestion , will try it ,and show the results here

Kkeyser_soze Which is the best way to train a AI generated character then

Furkan Gözükara SECourses•2/15/25, 11:33 AM

i recommend 2 stage

Furkan Gözükara SECourses•2/15/25, 11:33 AM

first train

Furkan Gözükara SECourses•2/15/25, 11:33 AM

generate better images

Furkan Gözükara SECourses•2/15/25, 11:33 AM

then collect more images

Furkan Gözükara SECourses•2/15/25, 11:33 AM

and train again

FFurkan Gözükara SECourses and train again

keyser_soze•2/15/25, 11:37 AM

Should I train the first trained Lora with a new dataset using more steps, or should I train from scratch using the images generated by the trained Lora as a dataset?

Kkeyser_soze Should I train the first trained Lora with a new dataset using more steps, or sh...

Furkan Gözükara SECourses•2/15/25, 11:49 AM

from scractch with new dataset

FFurkan Gözükara SECourses from scractch with new dataset

keyser_soze•2/15/25, 12:03 PM

cool

MetaKan•2/15/25, 12:55 PM

hi, getting this error installing Kohya_FLUX_DreamBooth_v17. Anyone can help?

Unc0nn3cteD•2/15/25, 2:04 PM

Hello Furkan, everyone!

I'm trying to get my head around the structure of the Patreon as well as tutorials and have a bit of a hard time to see where to start - will appreciate a pointer to a 101 or a tutorial

My use case WAS => Stable Diffusion 1.5 and some public CivitAI models + my own photography dataset with poses, light and bokehs (150-200 images) = New checkpoint + Dreambooth fine-tuning on a new person (50-100 images) = New checkpoint, that let me create portraits of people in my own recognizable photography style (Rembrandt light, bokehs, ethereal feeling). I used https://github.com/TheLastBen/fast-stable-diffusion workbook on Colab for both trainings (SD15/CIVIT + MyStyle-XYZ.jpg x 200 images) + (Person-XYZ x 100 images). Sample results are attached - these look exactly as real people to the extent the parents can't say if it is made with AI or not. With some experimenting I managed to get to 768 and 896 pixel resolutions here, all with Automatic1111.

What I want is to elevate this to SDXL with 1280 pixels and test out SDXL and CivitAI checkpoints. So, I would have 150-200 1024-1280px images to train my style and then 50-100 images of a person to generate images like (beautiful personXYZ as styleXYZ .... ). I can't find a reliable workbook (Colab or RunPod, paid are OK) with clear instructions. I have a good development background and PhD in CS, but in a slightly different area, so I struggle to get to the point where I have a code that works so that I could experiment. Like I found configs, but how do I set up the environment / deployed OneTrainer - but it won't accept .safetensors model / managed to adjust fast-stable-diffusion to accept SDXL, but it fails to work with GDrive

Any clues, hints or pointers I could use? Thank you so much in advance!

Cheers, Alex

MMetaKan hi, getting this error installing Kohya_FLUX_DreamBooth_v17. Anyone can help?

Furkan Gözükara SECourses•2/15/25, 2:21 PM

yes

Furkan Gözükara SECourses•2/15/25, 2:22 PM

you dont have proper requirements

Furkan Gözükara SECourses•2/15/25, 2:22 PM

it is python 3.11 first of all

Furkan Gözükara SECourses•2/15/25, 2:22 PM

follow every step : https://youtu.be/DrhUHnYfwC0

YouTubeSECourses

How to Install Python, CUDA, cuDNN, C++ Build Tools, FFMPEG & Git T...

If you are interested in using AI, generative AI applications, open source applications in your computer, than this is the most fundamental and important tutorial that you need. In this tutorial I show and explain how to properly install appropriate Python versions accurately, how to switch between different Python versions, how to install diffe...

UUnc0nn3cteD Hello Furkan, everyone! I'm trying to get my head around the structure of the P...

Furkan Gözükara SECourses•2/15/25, 6:04 PM

my recommendation is this video

Furkan Gözükara SECourses•2/15/25, 6:04 PM

it uses kohya and you can train on

Furkan Gözükara SECourses•2/15/25, 6:04 PM

runpod or massed compute

Furkan Gözükara SECourses•2/15/25, 6:04 PM

we have installers and config

Furkan Gözükara SECourses•2/15/25, 6:04 PM

https://youtu.be/FvpWy1x5etM

YouTubeSECourses

FLUX Full Fine-Tuning / DreamBooth Training Master Tutorial for Win...

If you want to train FLUX with maximum possible quality, this is the tutorial looking for. In this comprehensive tutorial, you will learn how to install Kohya GUI and use it to fully Fine-Tune / DreamBooth FLUX model. After that how to use SwarmUI to compare generated checkpoints / models and find the very best one to generate most amazing image...

Furkan Gözükara SECourses•2/15/25, 6:04 PM

this is most powerful way of training at the moment

FFurkan Gözükara SECourses this is most powerful way of training at the moment

Unc0nn3cteD•2/15/25, 6:08 PM

Thank you so much Furkan! I have my best prompts and community models that worked well for SDXL, which is the best and latest SDXL (not base model) tutorial?

UUnc0nn3cteD Thank you so much Furkan! I have my best prompts and community models that worke...

Furkan Gözükara SECourses•2/15/25, 7:25 PM

well we have SDXL config

Furkan Gözükara SECourses•2/15/25, 7:26 PM

so follow this tutorial

Furkan Gözükara SECourses•2/15/25, 7:26 PM

but when using config

Furkan Gözükara SECourses•2/15/25, 7:26 PM

use SDXL config and reg images

Furkan Gözükara SECourses•2/15/25, 7:26 PM

let me link few more

Furkan Gözükara SECourses•2/15/25, 7:26 PM