Software Engineering Courses (SECourses)•3y ago

Hello @Dr. Furkan Gözükara , may you help me with the comfyUI workflow? I want to replicate a stable

Hello @Dr. Furkan Gözükara , may you help me with the comfyUI workflow? I want to replicate a stable diffusion automatic1111 workflow so it can able to work on comfyUI

JMPA•12/16/23, 11:36 AM

After 20 hours of training,… it says this. Please help

JMPA•12/16/23, 11:36 AM

FFurkan Gözükara SECourses https://github.com/FurkanGozukara/Stable-Diffusion/blob/main/DreamBooth/ShivamSh...

Deleted User•12/16/23, 11:38 AM

Is this is sd 1.5

JJMPA Click to see attachment

JMPA•12/16/23, 11:51 AM

Oh I see no space on disk, should I restart all again, or can I continue from 7/8 epoch ??

JJMPA Oh I see no space on disk, should I restart all again, or can I continue from 7/...

Benjamin•12/16/23, 11:57 AM

you can continue, just use your last checkpoint (sixth one, I think seventh wasn't saved properly) as your base model (=instead of sdxl base model)

Benjamin•12/16/23, 11:58 AM

but of course beforehand you need to free space

JMPA•12/16/23, 11:59 AM

You mean I should use this instead of SDXL base 1.0 on Kohya training ?

Benjamin•12/16/23, 12:06 PM

correct

Benjamin•12/16/23, 12:06 PM

but you need to adjust the settings, as the training will start from the beginning

JMPA•12/16/23, 12:07 PM

I have other problem… I added these trained 1 to 6 to the Lora folder and I can’t see them here on stable diffusion

Benjamin•12/16/23, 12:07 PM

so you need to adjust the number of epochs for training

JJMPA I have other problem… I added these trained 1 to 6 to the Lora folder and I can’...

Benjamin•12/16/23, 12:07 PM

because they are not loras, they are full models just like sdxl base model

BBenjamin so you need to adjust the number of epochs for training

JMPA•12/16/23, 12:07 PM

Ok good to 2 I think so not?

Benjamin•12/16/23, 12:07 PM

so they need to be in another folder

BBenjamin because they are not loras, they are full models just like sdxl base model

JMPA•12/16/23, 12:07 PM

Ohhhh ok

Benjamin•12/16/23, 12:07 PM

yep

JMPA•12/16/23, 12:09 PM

As checkpoint

JMPA•12/16/23, 12:09 PM

So I should use the model here

JMPA•12/16/23, 12:10 PM

and ohwx man

JMPA•12/16/23, 12:10 PM

etc

Benjamin•12/16/23, 12:13 PM

yup

mikemenders•12/16/23, 12:25 PM

Did I mention that I love Prodigy for SD 1.5 Lora training?
I just tried it with a very poor quality image set. I extracted images from phone video, and CompreFace could only select 13 of them, almost all of which were a bit blurry. I started training this with 8x iterations on 64/64 with the usual Prodigy script with d_coef 0.6.
The end result could be said to be good, because the subject was similar, but produced images as blurred as the sample images. So it also captured the "style" of the sample photos well, which would be good, but in this case it's a drawback.
I tried using alpha 1, but by about the third epoch it was overdone. That would be fine if I wanted a Lora in a few minutes, but that wasn't the goal. So I reset the alpha to 32 and took the weight down to 32 as well. To slow down the overtraining, I also halved the d_coef to 0.3.
And the miracle happened! The result also yielded images with a score above 0.9 (it generated 0.97 the first time!), and it wasn't blurry! Fantastic! So for anyone interested in this script version, I've attached the file, and a sample prompt for you to experiment with.
This is not 100% "style"-free, but the quality is much better, and on 32/32!
So even after nearly 100 Lora, Prodigy continues to surprise and challenge.

Mykee_-_Prodigy_-_RealisticVision_-_Person_For_Low_Quality_Images-32.json3.4KB

iamannakogan•12/16/23, 12:26 PM

I have a question. For some people, the results of SDXL Dreamboots look OK in general, but the quality of the image is very low: skin texture, eyes, eyelashes. What can be the reason?

JMPA•12/16/23, 12:34 PM

Wich one should I use here for big realism?

mikemenders•12/16/23, 12:35 PM

I use DPM++ 2M Karras and DPM++ SDE Karras

Mmikemenders I use DPM++ 2M Karras and DPM++ SDE Karras

JMPA•12/16/23, 12:35 PM

Ok great

Mmikemenders I use DPM++ 2M Karras and DPM++ SDE Karras

JMPA•12/16/23, 12:38 PM

Do you use ADETAILER?

mikemenders•12/16/23, 12:39 PM

No, I use Hires Fix only. I hate Adetailer. It never delivered the results I expected.

JMPA•12/16/23, 12:40 PM

Yea I thought same

JMPA•12/16/23, 12:40 PM

And do you use negative prompts?

Mmikemenders Did I mention that I love Prodigy for SD 1.5 Lora training? I just tried it with...

Benjamin•12/16/23, 12:42 PM

how many repititions did you use? gonna try it out later

Benjamin•12/16/23, 12:44 PM

ah in the config it is 10 epochs so I assume you meant by 8 iterations = 8 rep

BBenjamin how many repititions did you use? gonna try it out later

mikemenders•12/16/23, 12:46 PM

I never touch epoch, it's always 10, and 99% of the time the last one is always the best. That's why I like Prodigy with cosine training, because I don't have to search for the best version because it's the last one.
I always calculate my reps like this: 100/number of images, and rounded up

mikemenders•12/16/23, 12:48 PM

These data are personal. For style (as you can see from the above) I need to train a stronger model, but there is labelling, so it's absolutely up to me how strong a style I want.

mikemenders•12/16/23, 12:49 PM

But if I stick to flexibility in style, I don't go above 2 for tensorboard normalization. Then I can mix style with the uniqueness of other models. But if I'm doing a very strong style, then it almost doesn't matter which model I choose to use.

BBenjamin ah in the config it is 10 epochs so I assume you meant by 8 iterations = 8 rep

mikemenders•12/16/23, 12:51 PM

I had 13 pictures, so 13*8 = 104

Mmikemenders I had 13 pictures, so 13*8 = 104

Benjamin•12/16/23, 12:59 PM

pretty good for sd 1.5. thanks for sharing your results

mikemenders•12/16/23, 1:37 PM

The great thing about Prodigy is that you can control the learning speed with two switches. The d_coef is the fine tuner, and the alpha is the coarser one. The lower the alpha, the faster it learns. So up to 5 epochs would be enough if the alpha is half the weight. This is just a theory, I haven't tested it, but it would make it even faster to train Lora, even in a few minutes (now about 10-15 minutes on an RTX 3090 card).

mikemenders•12/16/23, 1:39 PM

I like the 10 epoch and the 100 divisor because it's more transparent, and based on previous tests, it's really the right one, no more, no less. And for that you can already set the d_coef well.

mikemenders•12/16/23, 1:40 PM

And that's how I get the photo quality under SD 1.5, plus I can get a Lora model ready really quickly. No need to train DB.

mikemenders•12/16/23, 1:41 PM

I haven't switched to RealisticVision 6.x for training yet, I think 5.1 is good enough to get Lora results that work well on other models, and I get nice results on RV 6.x.

mikemenders•12/16/23, 1:55 PM

So with these results I think it's unnecessary to train on SDXL for now, maybe I'll think about SDXL-turbo if I can train it to get even better results in a small size.

mikemenders•12/16/23, 1:57 PM

Although someone recently argued for SD 2.1, that it could also be trained nicely, but many people quickly gave up on it. It's 768, so it might be worth a try with Prodigy.

magical•12/16/23, 3:06 PM

Hello my kaggle account got blocked can i create a new account using the same phone number?

omv421•12/16/23, 4:35 PM

https://github.com/AUTOMATIC1111/stable-diffusion-webui/releases/tag/v1.7.0

GitHub

Release 1.7.0 · AUTOMATIC1111/stable-diffusion-webui

Features:

settings tab rework: add search field, add categories, split UI settings page into many
add altdiffusion-m18 support (#13364)
support inference with LyCORIS GLora networks (#13610)
add l...

JJMPA You mean I should use this instead of SDXL base 1.0 on Kohya training ?

Xylber•12/16/23, 6:11 PM

Isn't that the new president of Argentina?

krigetaOP•12/16/23, 7:27 PM

I have a lora for lineart style, an image(simple lineart + colored lineart) both then how can we change the style of the little lineart only? Using controlnet or ipadapters? Or change the style of the plane colored image by some anime style lora?

Oomv421 https://github.com/AUTOMATIC1111/stable-diffusion-webui/releases/tag/v1.7.0

mikemenders•12/16/23, 7:49 PM

Someone explain this to me in a simple, understandable way, what is it for in 1.7.0 version?
https://github.com/AUTOMATIC1111/stable-diffusion-webui/pull/13568

GitHub

Add lora-embedding bundle system by KohakuBlueleaf · Pull Request #...

Description
Some Trainer (like hcp-diffusion, naifu) have implemented a method of training called "pivtoal tuning", which is basically trained Embedding and LoRA(DreamBooth) at the same t...

Oomv421 https://github.com/AUTOMATIC1111/stable-diffusion-webui/releases/tag/v1.7.0

Pelolisu•12/16/23, 7:56 PM

the funny thing is that in the dev branch there are still 132 commits that are not in this release, a lot of things are still to come and be adjusted.

Mmikemenders Someone explain this to me in a simple, understandable way, what is it for in 1....

Fire 🔥•12/16/23, 10:32 PM

It say right there in the issue:

We can now train Embeddings (aka Textual Inversion) and LoRA at the same time
However, multi-concept models produce many embedding files, one for each concept.
This adds a new feature to read "bundle" files that bundle many embeddings together into one

Hello @Dr. Furkan Gözükara , may you help me with the comfyUI workflow? I want to replicate a stable

Similar Threads