Software Engineering Courses (SECourses)•14mo ago

is it possible to speed up sdxl lora training using RAM?

XcorpionOP•11/28/24, 3:53 AM

does --network_train_unet_only--network_train_unet_only affect to the quality of the lora?

XcorpionOP•11/28/24, 3:55 AM

I found (reddit) it speeds up training but if the quality gets worse I gotta ignore it

XXcorpion is it possible to speed up sdxl lora training using RAM?

Furkan Gözükara SECourses•11/28/24, 10:31 AM

nope

XXcorpion does `--network_train_unet_only` affect to the quality of the lora?

Furkan Gözükara SECourses•11/28/24, 10:31 AM

yes because you dont train text encoder

Furkan Gözükara SECourses•11/28/24, 10:31 AM

so quality = lower

Zhigarev•11/28/24, 11:48 AM

Hello everyone! I trained my character, Conan, through finetuning, and now I want to add a LoRA with a film style. However, when working with LoRA from CIVITAI in the style of a specific film genre (e.g., Dark Fantasy movies from the 80s) or a type of lens (e.g., Anamorphic Lens), I encountered an issue: at high LoRA values, it radically changes the character's clothing and appearance or removes objects from the environment, but adheres to the style better. At lower values (around 0.5 or less), it either doesn't work or leaves some noise.

I understand that the authors of these LoRA models often use 30-50 images for style training, which might be the main limitation in the flexibility of LoRA models.

I could create a dataset of 100-500-1000 images for the Dark Fantasy movies 80s style. But tell me, should I train it on my already finetuned model with my character (will it affect his appearance too much?), or should I create a new LoRA with a larger dataset of images (100-300-500) for higher-quality generations? What do you think will work better?

ZZhigarev Hello everyone! I trained my character, Conan, through finetuning, and now I wan...

Furkan Gözükara SECourses•11/28/24, 1:05 PM

yes it would impact your character as long as those newly trained images have any same class

Furkan Gözükara SECourses•11/28/24, 1:05 PM

like containing a man in them

�

🍭🎀 𝒜𝓋𝒶 𝐹𝓇𝒾𝑔𝑔 🎀🍭•11/28/24, 1:13 PM

If I want a lora to impact only my characters body, should I crop to only include body in training images

my current solution is inpaintinf my face with segment as shown, but face does change when using the lora

�🍭🎀 𝒜𝓋𝒶 𝐹𝓇𝒾𝑔𝑔 🎀🍭If I want a lora to impact only my characters body, should I crop to only includ...

Furkan Gözükara SECourses•11/28/24, 1:16 PM

i dont know if that is possible you can try

FFurkan Gözükara SECourses yes it would impact your character as long as those newly trained images have an...

Zhigarev•11/28/24, 1:27 PM

What if there are creatures, landscapes, and women?

ZZhigarev What if there are creatures, landscapes, and women?

Furkan Gözükara SECourses•11/28/24, 1:27 PM

woman can bleed too

Furkan Gözükara SECourses•11/28/24, 1:27 PM

others shouldnt

FFurkan Gözükara SECourses others shouldnt

Zhigarev•11/28/24, 1:53 PM

What about the influence on Conan's staff's appearance? Will this style affect his clothing or appearance since it is critical?

ZZhigarev What about the influence on Conan's staff's appearance? Will this style affect h...

Furkan Gözükara SECourses•11/28/24, 1:56 PM

use different clothings in style it shouldnt memorize clothing

Furkan Gözükara SECourses•11/28/24, 1:56 PM

so shouldnt impact

FFurkan Gözükara SECourses so shouldnt impact

Zhigarev•11/28/24, 2:00 PM

Alright, then what are the settings for training through DreamBooth? As I understand it, your configs are more optimized and suitable for memorizing characters? Since for style, a more flexible mode of memorization is required, as well as detailed captions for greater flexibility?

FFurkan Gözükara SECourses so shouldnt impact

Zhigarev•11/28/24, 2:03 PM

And is it possible, for example, to use widescreen images for training so that it works better at this resolution? Moreover, this will simplify the process of preparing the dataset.

Zhigarev•11/28/24, 2:04 PM

like this

Nesshom•11/28/24, 2:41 PM

@NicB @SpecialHelper @Furkan Gözükara SECourses Hey guys I am currently following Dr. Furkans tutorial on how to do a Full File Tuning on Massed Compute and in the picture you can see what I want to deploy for the process.

1. But I dont know it the training will be faster if I use 2x A6000 with 96gb vram and more space.
2. I dont know hom much money I should put on the account for these trainings:

- 1x for me, 200 png dataset, various poses, expressions and clothing
- 1x for my Brother, 100 png dataset, various poses, expressions and clothing
(I want max quality possible)

And what parameters would you guys suggest me to use?

And I also don't know how to put money on the massed compute account and I have also connected my credit card

Nesshom•11/28/24, 6:04 PM

And also another thing that I would like to know is:

Can I close my Browser or even shut down my PC while the training is running on massed Compute? Because I saw that the the best training for about 250 images dataset will take about 30-31 hours per training

NNesshom And also another thing that I would like to know is: Can I close my Browser or ...

NicB•11/28/24, 6:20 PM

Just don't shutdown the VM instance in massed compute itself. It is like a separate computer for yours so everything will run as long as you don't shut it down

NNicB Just don't shutdown the VM instance in massed compute itself. It is like a separ...

Nesshom•11/28/24, 6:24 PM

Okey nice

NNicB Just don't shutdown the VM instance in massed compute itself. It is like a separ...

Nesshom•11/28/24, 6:25 PM

What about the other things like billing and so on?

NNesshom What about the other things like billing and so on?

NicB•11/28/24, 6:28 PM

Our billing by default is set for automatic charges. You only get charged for instance that are on the running instance page. So you can set thresholds as low as $5 for recharge amount and minimum balance amount.

Nesshom•11/28/24, 7:18 PM

Nur how Home I couldn’t deploy the gpu? It said you don’t have credits or something like that

Konstantinas•11/28/24, 8:03 PM

I was finetuning Flux, and at some point made prompt larger, and suddenly it failed when trying to generate test image after saving checkpoint. I wonder now, new prompt was only 88 words (356 characters), seems like all within limit. Maybe it was something else?

Konstantinas•11/28/24, 8:08 PM

or maybe its just some random memory error?

ZZhigarev Alright, then what are the settings for training through DreamBooth? As I unders...

Furkan Gözükara SECourses•11/28/24, 10:27 PM

nope not at all. my configs are designed to train any concept or even do fine tuning with large dataset

ZZhigarev And is it possible, for example, to use widescreen images for training so that i...

Furkan Gözükara SECourses•11/28/24, 10:27 PM

you should compare

NNesshom <@1167168099838074940> @SpecialHelper <@205854764540362752> Hey guys I am curre...

Furkan Gözükara SECourses•11/28/24, 10:28 PM

2x wont make difference

Furkan Gözükara SECourses•11/28/24, 10:28 PM

during fine tuning

Furkan Gözükara SECourses•11/28/24, 10:28 PM

but if you do 2x gpu lora it will be

KKonstantinas I was finetuning Flux, and at some point made prompt larger, and suddenly it fai...

Furkan Gözükara SECourses•11/28/24, 10:28 PM

ye that is why i dont recommend samples during training

Furkan Gözükara SECourses•11/28/24, 10:28 PM

they can also cause out of vram or ram error

wardensc2•11/29/24, 2:08 AM

I try to train new character checkpoint using pixelwave and failed miserably, the new trained checkpoint is so much noise and blur seem like beside of Flux Dev original model, mix or trained model is very difficult to use as a training base

gio3000.•11/29/24, 5:41 AM

hi @Furkan Gözükara SECourses what is the best way to train multiple person or is it best to create a model for each person ? If second
option is better what is the best aproach in confy ui to generate a single image with multiple model?

�

🍭🎀 𝒜𝓋𝒶 𝐹𝓇𝒾𝑔𝑔 🎀🍭•11/29/24, 9:28 AM

If I have 15 great 2048x2048 face pics, should I just these for training, or must I downsize to 1024 first? Any chance the 2048 pics will give better result or not?

�

🍭🎀 𝒜𝓋𝒶 𝐹𝓇𝒾𝑔𝑔 🎀🍭•11/29/24, 11:01 AM

Another thing, if I want the best possible lora, I won't loose details by first making fine tuned checkpoints, then converting? For this character I really want both, so was thinking of just doing fine tune, then convert the best epochs to loras.

�

🍭🎀 𝒜𝓋𝒶 𝐹𝓇𝒾𝑔𝑔 🎀🍭•11/29/24, 11:12 AM

I now get error when using your kohya_v16 install script, can't find the gui.sh.