Software Engineering Courses (SECourses)•3y ago

I have a question. For some people, the results of SDXL Dreamboots look OK in general, but the quali

I have a question. For some people, the results of SDXL Dreamboots look OK in general, but the quality of the image is very low: skin texture, eyes, eyelashes. What can be the reason?

JMPA•12/16/23, 12:34 PM

Wich one should I use here for big realism?

mikemenders•12/16/23, 12:35 PM

I use DPM++ 2M Karras and DPM++ SDE Karras

Mmikemenders I use DPM++ 2M Karras and DPM++ SDE Karras

JMPA•12/16/23, 12:35 PM

Ok great

Mmikemenders I use DPM++ 2M Karras and DPM++ SDE Karras

JMPA•12/16/23, 12:38 PM

Do you use ADETAILER?

mikemenders•12/16/23, 12:39 PM

No, I use Hires Fix only. I hate Adetailer. It never delivered the results I expected.

JMPA•12/16/23, 12:40 PM

Yea I thought same

JMPA•12/16/23, 12:40 PM

And do you use negative prompts?

Mmikemenders Did I mention that I love Prodigy for SD 1.5 Lora training? I just tried it with...

Benjamin•12/16/23, 12:42 PM

how many repititions did you use? gonna try it out later

Benjamin•12/16/23, 12:44 PM

ah in the config it is 10 epochs so I assume you meant by 8 iterations = 8 rep

BBenjamin how many repititions did you use? gonna try it out later

mikemenders•12/16/23, 12:46 PM

I never touch epoch, it's always 10, and 99% of the time the last one is always the best. That's why I like Prodigy with cosine training, because I don't have to search for the best version because it's the last one.
I always calculate my reps like this: 100/number of images, and rounded up

mikemenders•12/16/23, 12:48 PM

These data are personal. For style (as you can see from the above) I need to train a stronger model, but there is labelling, so it's absolutely up to me how strong a style I want.

mikemenders•12/16/23, 12:49 PM

But if I stick to flexibility in style, I don't go above 2 for tensorboard normalization. Then I can mix style with the uniqueness of other models. But if I'm doing a very strong style, then it almost doesn't matter which model I choose to use.

BBenjamin ah in the config it is 10 epochs so I assume you meant by 8 iterations = 8 rep

mikemenders•12/16/23, 12:51 PM

I had 13 pictures, so 13*8 = 104

Mmikemenders I had 13 pictures, so 13*8 = 104

Benjamin•12/16/23, 12:59 PM

pretty good for sd 1.5. thanks for sharing your results

mikemenders•12/16/23, 1:37 PM

The great thing about Prodigy is that you can control the learning speed with two switches. The d_coef is the fine tuner, and the alpha is the coarser one. The lower the alpha, the faster it learns. So up to 5 epochs would be enough if the alpha is half the weight. This is just a theory, I haven't tested it, but it would make it even faster to train Lora, even in a few minutes (now about 10-15 minutes on an RTX 3090 card).

mikemenders•12/16/23, 1:39 PM

I like the 10 epoch and the 100 divisor because it's more transparent, and based on previous tests, it's really the right one, no more, no less. And for that you can already set the d_coef well.

mikemenders•12/16/23, 1:40 PM

And that's how I get the photo quality under SD 1.5, plus I can get a Lora model ready really quickly. No need to train DB.

mikemenders•12/16/23, 1:41 PM

I haven't switched to RealisticVision 6.x for training yet, I think 5.1 is good enough to get Lora results that work well on other models, and I get nice results on RV 6.x.

mikemenders•12/16/23, 1:55 PM

So with these results I think it's unnecessary to train on SDXL for now, maybe I'll think about SDXL-turbo if I can train it to get even better results in a small size.

mikemenders•12/16/23, 1:57 PM

Although someone recently argued for SD 2.1, that it could also be trained nicely, but many people quickly gave up on it. It's 768, so it might be worth a try with Prodigy.

magical•12/16/23, 3:06 PM

Hello my kaggle account got blocked can i create a new account using the same phone number?

omv421•12/16/23, 4:35 PM

https://github.com/AUTOMATIC1111/stable-diffusion-webui/releases/tag/v1.7.0

GitHub

Release 1.7.0 · AUTOMATIC1111/stable-diffusion-webui

Features:

settings tab rework: add search field, add categories, split UI settings page into many
add altdiffusion-m18 support (#13364)
support inference with LyCORIS GLora networks (#13610)
add l...

JJMPA You mean I should use this instead of SDXL base 1.0 on Kohya training ?

Xylber•12/16/23, 6:11 PM

Isn't that the new president of Argentina?

krigeta•12/16/23, 7:27 PM

I have a lora for lineart style, an image(simple lineart + colored lineart) both then how can we change the style of the little lineart only? Using controlnet or ipadapters? Or change the style of the plane colored image by some anime style lora?

Oomv421 https://github.com/AUTOMATIC1111/stable-diffusion-webui/releases/tag/v1.7.0

mikemenders•12/16/23, 7:49 PM

Someone explain this to me in a simple, understandable way, what is it for in 1.7.0 version?
https://github.com/AUTOMATIC1111/stable-diffusion-webui/pull/13568

GitHub

Add lora-embedding bundle system by KohakuBlueleaf · Pull Request #...

Description
Some Trainer (like hcp-diffusion, naifu) have implemented a method of training called "pivtoal tuning", which is basically trained Embedding and LoRA(DreamBooth) at the same t...

Oomv421 https://github.com/AUTOMATIC1111/stable-diffusion-webui/releases/tag/v1.7.0

Pelolisu•12/16/23, 7:56 PM

the funny thing is that in the dev branch there are still 132 commits that are not in this release, a lot of things are still to come and be adjusted.

Mmikemenders Someone explain this to me in a simple, understandable way, what is it for in 1....

Fire 🔥•12/16/23, 10:32 PM

It say right there in the issue:

We can now train Embeddings (aka Textual Inversion) and LoRA at the same time
However, multi-concept models produce many embedding files, one for each concept.
This adds a new feature to read "bundle" files that bundle many embeddings together into one