Software Engineering Courses (SECourses)•3y ago

yes could be , after effects from adobe was running the same time i will try again with cleaner ram

yes could be , after effects from adobe was running the same time i will try again with cleaner ram
btw any difference between blip2-6.7 and coco version ?

EElisoli yes could be , after effects from adobe was running the same time i will try aga...

Furkan Gözükara SECourses•10/11/23, 12:53 PM

not much

Furkan Gözükara SECourses•10/11/23, 12:53 PM

i am still testing

mayna•10/11/23, 1:09 PM

just became a new patreon

FFurkan Gözükara SECourses https://www.patreon.com/posts/very-best-for-of-89213064

mayna•10/11/23, 1:11 PM

this is only for SD XL ?

Mmayna just became a new patreon 🙂

Furkan Gözükara SECourses•10/11/23, 1:11 PM

thank you so much

Mmayna this is only for SD XL ?

Furkan Gözükara SECourses•10/11/23, 1:12 PM

for sd 1.5 i suggest dreambooth extension

Furkan Gözükara SECourses•10/11/23, 1:12 PM

here the auto installer link and settings

Furkan Gözükara SECourses•10/11/23, 1:12 PM

https://www.patreon.com/posts/auto-installer-84773926

Furkan Gözükara SECourses•10/11/23, 1:12 PM

https://www.patreon.com/posts/best-settings-of-85192985

Furkan Gözükara SECourses•10/11/23, 1:12 PM

dreambooth extension supporting EMA

Furkan Gözükara SECourses•10/11/23, 1:12 PM

Kohya will also hopefully implement it

Furkan Gözükara SECourses•10/11/23, 1:13 PM

I will also research Kohya best settings for SD 1.5 too

FFurkan Gözükara SECourses https://www.patreon.com/posts/auto-installer-84773926

mayna•10/11/23, 1:16 PM

So the .json file is within the autoinstaller ? it comes with Parameters built in ? since it's in auto ?
I don't see the JSon file if not

FFurkan Gözükara SECourses it must be using shared ram

ElisoliOP•10/11/23, 1:48 PM

better now clean ram

mikemenders•10/11/23, 1:58 PM

I just trained a Lora model on RealisticVision with 32/32 (NR/NA) and Prodigy with these parameters:
decouple=True use_bias_correction=True safeguard_warmup=True

It's amazing to achieve professional results with such low weights on a SD 1.5 model. Here is a sample (original and hires fixed):

41494-4086313720-asd_woman_sitting_in_a_chair_in_the_restaurant_bride_veil_on_her_head_brown_hair_some_man_look_at_viewer_portrait_front.png

41493-4086313720-asd_woman_sitting_in_a_chair_in_the_restaurant_bride_veil_on_her_head_brown_hair_some_man_look_at_viewer_portrait_front-before-highres-fix.png

FFurkan Gözükara SECourses for sd 1.5 i suggest dreambooth extension

mayna•10/11/23, 2:16 PM

i do prefer lora Kohya ss and I also started following your video ( produce studio quality images)
I installed the Kohysa ss Gui , now I only need the setup parameters ( if you have any json file ready )
is the one in this link work with kohya ss ?

Mmayna i do prefer lora Kohya ss and I also started following your video ( produce stu...

Furkan Gözükara SECourses•10/11/23, 2:41 PM

for sd 1.5 i am still in research. i have this but it is not best here : https://www.patreon.com/posts/best-stable-1-5-90307694

EElisoli better now clean ram

Furkan Gözükara SECourses•10/11/23, 2:41 PM

Mmikemenders I just trained a Lora model on RealisticVision with 32/32 (NR/NA) and Prodigy wi...

Furkan Gözükara SECourses•10/11/23, 2:41 PM

interesting i should test it

Furkan Gözükara SECourses•10/11/23, 2:42 PM

can you send me config file

mikemenders•10/11/23, 3:00 PM

I sent it.

FFurkan Gözükara SECourses interesting i should test it

mikemenders•10/11/23, 3:12 PM

What I leave as a default, I don't set as a parameter, it's unnecessary. I only put in as an args parameter what I modify.

Furkan Gözükara SECourses•10/11/23, 3:13 PM

here a golden info

Furkan Gözükara SECourses•10/11/23, 3:13 PM

https://twitter.com/GozukaraFurkan/status/1712124240822940144

stillmotion•10/11/23, 3:26 PM

@Dr. Furkan Gözükara any clue what part of the pipeline is causing my sdxl dreambooth fine tunes to output noise?

8ba7af1511ab6f3c9e884e3c1d5b01db7c505ac19aeb2d5121668890eea2d030_image.png

stillmotion•10/11/23, 3:30 PM

I had it working end to end a few days ago, but I think I broke something. Trying to figure out if the training was bad or if it's an inference problem...

stillmotion•10/11/23, 3:31 PM

My hunch is switching to the fp16 vae. Have you encountered similar noise?

Sstillmotion @Dr. Furkan Gözükara any clue what part of the pipeline is causing my sdxl dream...

Furkan Gözükara SECourses•10/11/23, 3:33 PM

VAE

Furkan Gözükara SECourses•10/11/23, 3:33 PM

overcooked unet

stillmotion•10/11/23, 3:33 PM

ok, I'll check the earlier checkpoints to see if it's overcooked

stillmotion•10/11/23, 3:55 PM

@Dr. Furkan Gözükara ok getting the same output for all the checkpoints, so definitely a vae issue. How can I identify if it's an issue with the inference configuration vs. the vae I configured for training?

stillmotion•10/11/23, 3:56 PM

Not convinced I'm loading the vae or unet with the correct dtype

Sstillmotion @Dr. Furkan Gözükara ok getting the same output for all the checkpoints, so defi...

Furkan Gözükara SECourses•10/11/23, 4:46 PM

which vae do you chose during inference?

stillmotion•10/11/23, 4:53 PM

The one you linked me last week. This is how I'm loading via diffusers:

        vae = AutoencoderKL.from_pretrained(
            "stabilityai/sdxl-vae", torch_dtype=torch.float16
        )

        vae = AutoencoderKL.from_pretrained(
            "stabilityai/sdxl-vae", torch_dtype=torch.float16
        )

stillmotion•10/11/23, 4:54 PM

afaik that one doesn't have the NaN issues

stillmotion•10/11/23, 4:56 PM

Ah, I'm not generating samples during training. I'll do that to check if there's an issue with the training, since it uses the same vae and config

stillmotion•10/11/23, 5:44 PM

@Dr. Furkan Gözükara ok yeah, my sample looks like this. Probably the way I'm loading the vae

akellio•10/11/23, 6:48 PM

Hi, i have this error now when i run the kohya interface

Zono50•10/11/23, 7:01 PM

What's the best way to fix the blurryness in this photo, upscaling doesn't seem to do anything

Sstillmotion @Dr. Furkan Gözükara ok yeah, my sample looks like this. Probably the way I'm lo...

Furkan Gözükara SECourses•10/11/23, 7:31 PM

what do you use to laod vae?

Furkan Gözükara SECourses•10/11/23, 7:31 PM

you dont use auto1111?,

Aakellio Hi, i have this error now when i run the kohya interface

Furkan Gözükara SECourses•10/11/23, 7:31 PM

use my auto installer

Furkan Gözükara SECourses•10/11/23, 7:31 PM

https://www.patreon.com/posts/for-runpod-kohya-84898806

ZZono50 What's the best way to fix the blurryness in this photo, upscaling doesn't seem ...

Furkan Gözükara SECourses•10/11/23, 7:32 PM

high res fix usually

FFurkan Gözükara SECourses use my auto installer

akellio•10/11/23, 7:32 PM

it's a kaggle problem

Aakellio it's a kaggle problem

Furkan Gözükara SECourses•10/11/23, 7:32 PM

i updted kaggle notebook

Furkan Gözükara SECourses•10/11/23, 7:33 PM

now works better

Furkan Gözükara SECourses•10/11/23, 7:33 PM

we use working directory

Furkan Gözükara SECourses•10/11/23, 7:33 PM

temp is too slow

Furkan Gözükara SECourses•10/11/23, 7:33 PM

fails

yes could be , after effects from adobe was running the same time i will try again with cleaner ram

Similar Threads

Similar Threads

Similar Threads