Software Engineering Courses (SECourses)•3y ago

hey , relly i cant find on youtube , a updated workflow . haw to make my own videous into animation

hey , relly i cant find on youtube , a updated workflow . haw to make my own videous into animation with stable diffusion , @Dr. Furkan Gözükara you made a video like 6 mounths ago , could you please point me in a updated direction , i dont need perfection i just want to create my ai video creatios , my daughters into someghing

Elisoli•10/21/23, 6:41 PM

I wonder if we could use this amazing sdxl checkpoint to train our characters dreambooth - https://learn.thinkdiffusion.com/thinkdiffusionxl-model-draft/

Aakellio I tried to update canny but it does not initialize controlonet

akellio•10/21/23, 7:11 PM

Deleted the download folder in /working, deleted cn-models in the root folder, still copied and pasted all over again, no way I can not update

EElisoli I wonder if we could use this amazing sdxl checkpoint to train our characters dr...

mikemenders•10/21/23, 7:22 PM

Why not?
https://civitai.com/models/169868/thinkdiffusionxl

mikemenders•10/21/23, 7:30 PM

I've been looking at Lora's profiles for days, trying to find the best settings for poses and styles. I also trained two Lora's today, and in one of them, epoch 9 and epoch 10 produce completely different output with the same seed, so there are some interesting switches to hash out.
I'm curious, for either DB or Lora, what do you use to set the number of iterations of the folders? Because I see illogical iteration numbers like 12 or 16, while the number of images is 104 and similar non-round numbers. So just by taste, maybe there is a rule?

DDR.Siva https://github.com/cheald/sd-webui-loractl This extension sounds that we can ba...

Elisoli•10/21/23, 8:29 PM

this is amazing thank you for this

Elisoli•10/21/23, 8:29 PM

very useful

LLEGACIES I am using Photon_v1 as based model, not sure what is bucketing

Furkan Gözükara SECourses•10/21/23, 9:00 PM

bucketing is used during training

Furkan Gözükara SECourses•10/21/23, 9:00 PM

different resolution images put into different buckets

DDR.Siva everytime i want to do a 32:9 aspect ratio wallpaper , it struggles and spits a ...

Furkan Gözükara SECourses•10/21/23, 9:00 PM

ye it is a so big ratio

Furkan Gözükara SECourses•10/21/23, 9:00 PM

suggested resolutions are here :

EElisoli What kind of class classification can i use for training my child (3 years old) ...

Furkan Gözükara SECourses•10/21/23, 9:02 PM

this is hard. maybe not use

DDR.Siva @Dr. Furkan Gözükara , is your tutorial on controlnet same for SDXL too ? Only d...

Furkan Gözükara SECourses•10/21/23, 9:02 PM

yep same

Furkan Gözükara SECourses•10/21/23, 9:02 PM

only you download sdxl models

MMaxGangsterTV who can tell me to reinstall Windows, I run vlad sdnext, and it doesn't start, w...

Furkan Gözükara SECourses•10/21/23, 9:03 PM

i think try to install into C drive

Aakellio how can i use controlnet in sdxl in runpod? It only installs outdated models

Furkan Gözükara SECourses•10/21/23, 9:04 PM

here auto installer tht install and download all : https://www.patreon.com/posts/for-runpod-and-84896373

DDeme hey , relly i cant find on youtube , a updated workflow . haw to make my own vid...

Furkan Gözükara SECourses•10/21/23, 9:05 PM

sure here : https://youtu.be/kmT-z2lqEPQ

YouTubeSECourses

Video To Anime - Generate An EPIC Animation From Your Phone Recordi...

RunPod: https://bit.ly/RunPodIO. Discord : https://bit.ly/SECoursesDiscord. Turn your real video into an animation with just 1 click by using Stable Diffusion for free. If I have been of assistance to you and you would like to show your support for my work, please consider becoming a patron on

https://www.patreon.com/SECourses

Playlist of Sta...

Video To Anime - Generate An EPIC Animation From Your Phone Recordi...

Furkan Gözükara SECourses•10/21/23, 9:05 PM

also you can use rerender

Furkan Gözükara SECourses•10/21/23, 9:05 PM

https://youtu.be/a8oeCFyM5gA

YouTubeSECourses

Turn Videos Into Animation With Just 1 Click - ReRender A Video Tut...

In this video I share automatic Windows installer for ReRender A Video github repository - open source AI project. The auto installer script is here : https://www.patreon.com/posts/1-click-auto-for-89457537

Auto script is here : https://www.patreon.com/posts/1-click-auto-for-89457537

Official repo is here : https://github.com/williamyang1991...

EElisoli I wonder if we could use this amazing sdxl checkpoint to train our characters dr...

Furkan Gözükara SECourses•10/21/23, 9:05 PM

yes you can use all. give it a try

FFurkan Gözükara SECourses here auto installer tht install and download all : https://www.patreon.com/posts...

akellio•10/21/23, 9:06 PM

I felt stupid for dealing with this for hours

Aakellio I felt stupid for dealing with this for hours😭

Furkan Gözükara SECourses•10/21/23, 9:06 PM

sorry i was away whole time

FFurkan Gözükara SECourses sorry i was away whole time

akellio•10/21/23, 9:11 PM

can you briefly explain why it keeps adding the controlnet extension if you delete the folder manually?

Aakellio can you briefly explain why it keeps adding the controlnet extension if you dele...

Furkan Gözükara SECourses•10/21/23, 9:13 PM

it is in their template

akellio•10/21/23, 9:33 PM

what kind of models does rerender use? sd 1.5?

Aakellio what kind of models does rerender use? sd 1.5?

Furkan Gözükara SECourses•10/21/23, 9:35 PM

it supports all sd 1.5

Furkan Gözükara SECourses•10/21/23, 11:03 PM

check this out : https://twitter.com/GozukaraFurkan/status/1715866094378832122

Furkan Gözükara SECourses•10/21/23, 11:33 PM

updated for sdxl dreambooth on kaggle - free account : https://www.patreon.com/posts/88397937

Furkan Gözükara SECourses•10/21/23, 11:38 PM

https://twitter.com/GozukaraFurkan/status/1715874999204982896

GeorgeClintonGeorgeBush•10/22/23, 4:16 AM

What's the current best SDXL checkpoint for realistic photos of people?

phillip•10/22/23, 5:08 AM

Is there a youtube video or something how to use this kind of caption for Lora? @Dr. Furkan Gözükara

Marcelo•10/22/23, 5:30 AM

Sdxl quality is insane, thank you for everything @Dr. Furkan Gözükara . Its 2 pm where I live and I managed to successfully create my very first high quality model. I had to tweak the learning rate at least 4 times, because it was overtraining too fast, but the final result is incredible. Thank u so much for your videos, tutorials and scripts, glad to be a patreon supporter :100_rainbow:

MMarcelo Sdxl quality is insane, thank you for everything @Dr. Furkan Gözükara . Its 2 pm...

Benjamin•10/22/23, 6:50 AM

what learning rate did you end up with?

FFurkan Gözükara SECourses https://twitter.com/GozukaraFurkan/status/1715874999204982896

Benjamin•10/22/23, 6:52 AM

great news

FFurkan Gözükara SECourses updated for sdxl dreambooth on kaggle - free account : https://www.patreon.com/p...

Benjamin•10/22/23, 7:01 AM

is it maybe possible to save more checkpoints if we put them in a temporary folder like we used to do with the downloaded models?

LEGACIES•10/22/23, 7:07 AM

@Dr. Furkan Gözükara is it more accurate to crop my dataset with your auto crop script compared to cropping it with photoshop?

LEGACIES•10/22/23, 7:29 AM

How to enable bucketing?

mikemenders•10/22/23, 8:44 AM

In kohya here:

mikemenders•10/22/23, 10:27 AM

I just trained a six-keyword Lora for SD 1.5 (poses). And it's nice to see that it produces results for all six keywords nicely, and just need a minimal Hires fix (0.3) for face. With AdamW8bit optimizer, with these settings (almost the same as I shared earlier, slightly modified and higher weights).
Now I'm retraining with the same parameters, but I've turned on normalization, which also gave interesting results yesterday, but as I saw, it does match the Lora to the base model. I'll be curious to see what I end up with.

Mykee_-_AdamW_-_SD15_-_Concept_best.json2.79KB

mikemenders•10/22/23, 10:40 AM

@Dr. Furkan Gözükara check this PR

https://github.com/kohya-ss/sd-scripts/pull/893

GitHub

Add EMA by vvern999 · Pull Request #893 · kohya-ss/sd-scripts

Add EMA support. Usually it is used like this:

At the start of training, the model parameters are copied to the EMA parameters.
At each gradient update step, the EMA parameters are updated using t...

BBenjamin what learning rate did you end up with?

Marcelo•10/22/23, 10:57 AM

2e-05

Sandstormleader•10/22/23, 12:31 PM

@Dr. Furkan Gözükara do we have an up to date version of dreambooth and automatic1111 that is working yet or do i still need to train from older version?

Sandstormleader•10/22/23, 12:32 PM

was hoping to try training my first sdxl model today

Mmikemenders @Dr. Furkan Gözükara check this PR 😉 https://github.com/kohya-ss/sd-scripts/pul...

Benjamin•10/22/23, 1:02 PM

maybe interesting for you @mikemenders : https://github.com/bghira/SimpleTuner/releases/tag/v0.7.0

GitHub

Release v0.7.0 - tune SDXL in just 12G VRAM! · bghira/SimpleTuner

DeepSpeed lives!
Now correctly integrated, DeepSpeed allows for training SDXL's full U-net at 8 seconds per iteration on just ~12G of VRAM. See the documentation for more information!
Features
...

sharkdodo•10/22/23, 1:06 PM

a question on lora with various checkpoints: in the previous sd1.5 era, i could train a lora on sd1.5 or anylora checkpoint and use that lora on almost any checkpoints without fail. However, loras trained on & tested ok with sdxl model doesnt seem to work at all with other checkpoints (such as realVisXL) - it generates a lot of artifacts as if overtrained. Does anyone have idea why?

Sandstormleader•10/22/23, 1:31 PM

anyone have a link to the automatic1111 sdxl auto installer for windows?