Software Engineering Courses (SECourses)•3y ago

ah okay, honestly I'm only looking at this

LLorelai AI Do you change the LR scheduler?

FiveSAI•12/9/23, 8:08 PM

Yep metioned it above ^ Also if you feel like constant learning rate is cooking your image, switch to cosine

LLorelai AI And B16 or F16?

FiveSAI•12/9/23, 8:08 PM

bf16 since you're on a 4090

YYorth - 夜土 ah okay, honestly I'm only looking at this

FiveSAI•12/9/23, 8:09 PM

try putting it like this /stabilityai/stable-diffusion-xl-base-1.0

Yorth - 夜土OP•12/9/23, 8:10 PM

ah, that's chill, I think it wants me to download it and give it the full path. I can do that

Yorth - 夜土OP•12/9/23, 8:11 PM

the issue is honestly with the dataset, if I just give it this Yorth/dalleTestDataFiltered2, it will make life much easier than downloading the dataset, separating the image folder, finding a way to link them with the captions without messing things up

Yorth - 夜土OP•12/9/23, 8:11 PM

:sigh:

FFiveSAI bf16 since you're on a 4090

Lorelai AI•12/9/23, 8:20 PM

I’m playing around and the numbers are dropping. For reference are your settings based on 512 by 512? I’m using 768 by 1344

FiveSAI•12/9/23, 8:22 PM

Mine is 1024x1024, and on 1536x1536 it takes around 2 and half hours

LLorelai AI I’m playing around and the numbers are dropping. For reference are your settings...

FiveSAI•12/9/23, 8:23 PM

can you share me your cmd, like a secreenshot of it

FiveSAI•12/9/23, 8:23 PM

you can dm if you want

Lorelai AI•12/9/23, 8:24 PM

What’s a cmd?

LLorelai AI What’s a cmd?

FiveSAI•12/9/23, 8:24 PM

the terminal where the kohay gui is

FiveSAI•12/9/23, 8:24 PM

where it tells you the progress of training

Lorelai AI•12/9/23, 8:25 PM

Sure

FiveSAI•12/9/23, 8:26 PM

also your kohya could be bad, so maybe reinstall it as well, and reconfigure accelerate

Lorelai AI•12/9/23, 8:26 PM

Lorelai AI•12/9/23, 8:26 PM

It’s much better with your suggestions

FiveSAI•12/9/23, 8:27 PM

whats your vram usage?

Lorelai AI•12/9/23, 8:27 PM

How do I check that?

FiveSAI•12/9/23, 8:27 PM

search for task manager

FiveSAI•12/9/23, 8:27 PM

then go to performance and then to gpu

Lorelai AI•12/9/23, 8:28 PM

It’s tinkering at 100 percent is that normal

FiveSAI•12/9/23, 8:28 PM

okay cancel the training, and enable gradient checkpointing

FiveSAI•12/9/23, 8:29 PM

also 2080 steps is a little low, so maybe up your repeats by 10 or epochs to 14

Lorelai AI•12/9/23, 8:30 PM

This Konya version doesn’t have all the older one has, is there a hidden spot for gradient checkpoints

FiveSAI•12/9/23, 8:30 PM

which version are you on?

Lorelai AI•12/9/23, 8:31 PM

22.1.0

FiveSAI•12/9/23, 8:32 PM

the min snr gamma is optional sometimes it gives better results

FiveSAI•12/9/23, 8:32 PM

and then i have noise ofset at 0.0357 for sdxl

LLorelai AI 22.1.0

FiveSAI•12/9/23, 8:33 PM

upgrade to the latest version when you get a chance

Lorelai AI•12/9/23, 8:34 PM

Found it, do I not have the latest?

FiveSAI•12/9/23, 8:34 PM

22.3.0 is the latest

Lorelai AI•12/9/23, 8:35 PM

What’s the best way to upgrade?

FiveSAI•12/9/23, 8:35 PM

https://github.com/bmaltais/kohya_ss/releases/tag/v22.3.0

GitHub

Release v22.3.0 · bmaltais/kohya_ss

2023/12/06 (v22.3.0)

Merge sd-scripts updates:

finetune\tag_images_by_wd14_tagger.py now supports the separator other than , with --caption_separator option. Thanks to KohakuBlueleaf! PR #913
Mi...