Software Engineering Courses (SECourses)•3y ago

@Dr. Furkan Gözükara my dataset is 512px x 768px and I have trained max resolution 768px. Any partic

@Dr. Furkan Gözükara my dataset is 512px x 768px and I have trained max resolution 768px. Any particupar reason why the generated images have more ressemblance with my dataset when generate at 768px x 768px compared to those generated 512px x 768px?

Greg•10/20/23, 7:03 PM

Hi all, I'm a brand new Patreon supporter. I'm following the tutorial to make a LoRA training of myself in Kaggle. But I get the following error:

torch.cuda.OutOfMemoryError: CUDA out of memory. Tried to allocate 20.00 MiB (GPU 0; 14.76 GiB total capacity; 13.17 GiB already allocated; 7.75 MiB free; 13.46 GiB reserved in total by PyTorch

torch.cuda.OutOfMemoryError: CUDA out of memory. Tried to allocate 20.00 MiB (GPU 0; 14.76 GiB total capacity; 13.17 GiB already allocated; 7.75 MiB free; 13.46 GiB reserved in total by PyTorch

Here is my training command:

accelerate launch --num_cpu_threads_per_process=2 "./sdxl_train_network.py" --pretrained_model_name_or_path="stabilityai/stable-diffusion-xl-base-1.0" --train_data_dir="/kaggle/working/results/img" --reg_data_dir="/kaggle/working/results/reg" --resolution="1024,1024" --output_dir="/kaggle/working/results/model" --logging_dir="/kaggle/working/results/log" --network_alpha="1" --save_model_as=safetensors --network_module=networks.lora --text_encoder_lr=0.0004 --unet_lr=0.0004 --network_dim=32 --output_name="kaggle_glpr123" --lr_scheduler_num_cycles="8" --no_half_vae --learning_rate="0.0004" --lr_scheduler="constant" --train_batch_size="1" --max_train_steps="6400" --save_every_n_epochs="1" --mixed_precision="fp16" --save_precision="fp16" --cache_latents --optimizer_type="Adafactor" --optimizer_args scale_parameter=False relative_step=False warmup_init=False --max_data_loader_n_workers="0" --bucket_reso_steps=64 --full_fp16 --xformers --bucket_no_upscale --noise_offset=0.0 --lowram --max_grad_norm=0.0

accelerate launch --num_cpu_threads_per_process=2 "./sdxl_train_network.py" --pretrained_model_name_or_path="stabilityai/stable-diffusion-xl-base-1.0" --train_data_dir="/kaggle/working/results/img" --reg_data_dir="/kaggle/working/results/reg" --resolution="1024,1024" --output_dir="/kaggle/working/results/model" --logging_dir="/kaggle/working/results/log" --network_alpha="1" --save_model_as=safetensors --network_module=networks.lora --text_encoder_lr=0.0004 --unet_lr=0.0004 --network_dim=32 --output_name="kaggle_glpr123" --lr_scheduler_num_cycles="8" --no_half_vae --learning_rate="0.0004" --lr_scheduler="constant" --train_batch_size="1" --max_train_steps="6400" --save_every_n_epochs="1" --mixed_precision="fp16" --save_precision="fp16" --cache_latents --optimizer_type="Adafactor" --optimizer_args scale_parameter=False relative_step=False warmup_init=False --max_data_loader_n_workers="0" --bucket_reso_steps=64 --full_fp16 --xformers --bucket_no_upscale --noise_offset=0.0 --lowram --max_grad_norm=0.0

mikemenders•10/20/23, 8:11 PM

If I'm tagging with WD14 and it's a drawing style, but I don't want it to be an asian/manga type model, which one should I train on?

mikemenders•10/20/23, 8:35 PM

MeinaMix maybe?

LLEGACIES @Dr. Furkan Gözükara my dataset is 512px x 768px and I have trained max resoluti...

Furkan Gözükara SECourses•10/20/23, 8:44 PM

which model? also did you enable bucketing?

GGreg Hi all, I'm a brand new Patreon supporter. I'm following the tutorial to make a ...

Furkan Gözükara SECourses•10/20/23, 8:44 PM

hello welcome

Furkan Gözükara SECourses•10/20/23, 8:45 PM

gradient checkpointing missing.

Mmikemenders MeinaMix maybe?

Furkan Gözükara SECourses•10/20/23, 8:45 PM

i think you need to test on models

akellio•10/20/23, 10:12 PM

Hi, it is possible to use own lora in rerender?

akellio•10/20/23, 10:22 PM

and is it possible to make the first keyframe separately? (made in the automation interface, for example)

Aakellio Hi, it is possible to use own lora in rerender?

Furkan Gözükara SECourses•10/20/23, 11:15 PM

i think yes

Aakellio and is it possible to make the first keyframe separately? (made in the automatio...

Furkan Gözükara SECourses•10/20/23, 11:15 PM

i am not sure but probably possible

Furkan Gözükara SECourses•10/20/23, 11:15 PM

it is open source

DR.Siva•10/20/23, 11:31 PM

https://www.reddit.com/r/StableDiffusion/comments/17cgh2e/massive_sdnext_update/

From the StableDiffusion community on Reddit: Massive SDNext update

Explore this post and more from the StableDiffusion community

DDR.Siva https://www.reddit.com/r/StableDiffusion/comments/17cgh2e/massive_sdnext_update/

Furkan Gözükara SECourses•10/21/23, 12:38 AM

testing righ tnow

Furkan Gözükara SECourses•10/21/23, 12:44 AM

so many packages to install lol

Furkan Gözükara SECourses•10/21/23, 12:49 AM

lol still installing

Furkan Gözükara SECourses•10/21/23, 12:55 AM

it failed haha

DR.Siva•10/21/23, 12:56 AM

ohhh

Furkan Gözükara SECourses•10/21/23, 1:00 AM

the interface is also terrible

Furkan Gözükara SECourses•10/21/23, 1:00 AM

sd 1.5 worked

Furkan Gözükara SECourses•10/21/23, 1:00 AM

almost same speed

FFurkan Gözükara SECourses which model? also did you enable bucketing?

LEGACIESOP•10/21/23, 3:30 AM

I am using Photon_v1 as based model, not sure what is bucketing

DR.Siva•10/21/23, 5:15 AM

everytime i want to do a 32:9 aspect ratio wallpaper , it struggles and spits a runtime error. anyone had any luck ? I run dual monitor and thought 2240x630 would work..

DR.Siva•10/21/23, 5:15 AM

then i can upscale , i dont think it works that way

DR.Siva•10/21/23, 5:15 AM

even the width is limited to 2048

Elisoli•10/21/23, 8:15 AM

What kind of class classification can i use for training my child (3 years old) - like man\woman(child?)

DR.Siva•10/21/23, 9:36 AM

https://github.com/cheald/sd-webui-loractl
This extension sounds that we can balance loras depending on how powerful they are. Very interesting. (thanks to reddit)

GitHub

GitHub - cheald/sd-webui-loractl: An Automatic1111 extension for dy...

An Automatic1111 extension for dynamically controlling the weights of LoRAs during image generation - GitHub - cheald/sd-webui-loractl: An Automatic1111 extension for dynamically controlling the we...

FFurkan Gözükara SECourses which model? also did you enable bucketing?

LEGACIESOP•10/21/23, 12:40 PM

@Dr. Furkan Gözükara do you think thwt your auto cropping script can help to solve it?

DR.Siva•10/21/23, 2:01 PM

@Dr. Furkan Gözükara , is your tutorial on controlnet same for SDXL too ? Only difference being the SDXL models right ?

DR.Siva•10/21/23, 2:01 PM

https://huggingface.co/lllyasviel/sd_control_collection/tree/main

lllyasviel/sd_control_collection at main

MaxGangsterTV•10/21/23, 2:27 PM

who can tell me to reinstall Windows, I run vlad sdnext, and it doesn't start, what to do

akellio•10/21/23, 4:35 PM

how can i use controlnet in sdxl in runpod? It only installs outdated models

akellio•10/21/23, 4:47 PM

I tried to update canny but it does not initialize controlonet

Deme•10/21/23, 6:01 PM

hey , relly i cant find on youtube , a updated workflow . haw to make my own videous into animation with stable diffusion , @Dr. Furkan Gözükara you made a video like 6 mounths ago , could you please point me in a updated direction , i dont need perfection i just want to create my ai video creatios , my daughters into someghing

Elisoli•10/21/23, 6:41 PM

I wonder if we could use this amazing sdxl checkpoint to train our characters dreambooth - https://learn.thinkdiffusion.com/thinkdiffusionxl-model-draft/

Aakellio I tried to update canny but it does not initialize controlonet

akellio•10/21/23, 7:11 PM

Deleted the download folder in /working, deleted cn-models in the root folder, still copied and pasted all over again, no way I can not update

EElisoli I wonder if we could use this amazing sdxl checkpoint to train our characters dr...

mikemenders•10/21/23, 7:22 PM

Why not?
https://civitai.com/models/169868/thinkdiffusionxl

mikemenders•10/21/23, 7:30 PM

I've been looking at Lora's profiles for days, trying to find the best settings for poses and styles. I also trained two Lora's today, and in one of them, epoch 9 and epoch 10 produce completely different output with the same seed, so there are some interesting switches to hash out.
I'm curious, for either DB or Lora, what do you use to set the number of iterations of the folders? Because I see illogical iteration numbers like 12 or 16, while the number of images is 104 and similar non-round numbers. So just by taste, maybe there is a rule?

DDR.Siva https://github.com/cheald/sd-webui-loractl This extension sounds that we can ba...

Elisoli•10/21/23, 8:29 PM

this is amazing thank you for this

Elisoli•10/21/23, 8:29 PM

very useful

LLEGACIES I am using Photon_v1 as based model, not sure what is bucketing

Furkan Gözükara SECourses•10/21/23, 9:00 PM

bucketing is used during training

Furkan Gözükara SECourses•10/21/23, 9:00 PM

different resolution images put into different buckets

DDR.Siva everytime i want to do a 32:9 aspect ratio wallpaper , it struggles and spits a ...

Furkan Gözükara SECourses•10/21/23, 9:00 PM

ye it is a so big ratio

Furkan Gözükara SECourses•10/21/23, 9:00 PM

suggested resolutions are here :

EElisoli What kind of class classification can i use for training my child (3 years old) ...

Furkan Gözükara SECourses•10/21/23, 9:02 PM

this is hard. maybe not use

DDR.Siva @Dr. Furkan Gözükara , is your tutorial on controlnet same for SDXL too ? Only d...

Furkan Gözükara SECourses•10/21/23, 9:02 PM

yep same

Furkan Gözükara SECourses•10/21/23, 9:02 PM

only you download sdxl models

MMaxGangsterTV who can tell me to reinstall Windows, I run vlad sdnext, and it doesn't start, w...

Furkan Gözükara SECourses•10/21/23, 9:03 PM

i think try to install into C drive

Aakellio how can i use controlnet in sdxl in runpod? It only installs outdated models

Furkan Gözükara SECourses•10/21/23, 9:04 PM

here auto installer tht install and download all : https://www.patreon.com/posts/for-runpod-and-84896373

DDeme hey , relly i cant find on youtube , a updated workflow . haw to make my own vid...

Furkan Gözükara SECourses•10/21/23, 9:05 PM

sure here : https://youtu.be/kmT-z2lqEPQ

YouTubeSECourses

Video To Anime - Generate An EPIC Animation From Your Phone Recordi...

RunPod: https://bit.ly/RunPodIO. Discord : https://bit.ly/SECoursesDiscord. Turn your real video into an animation with just 1 click by using Stable Diffusion for free. If I have been of assistance to you and you would like to show your support for my work, please consider becoming a patron on

https://www.patreon.com/SECourses

Playlist of Sta...

Video To Anime - Generate An EPIC Animation From Your Phone Recordi...

accelerate launch --num_cpu_threads_per_process=2 "./sdxl_train_network.py" --pretrained_model_name_or_path="stabilityai/stable-diffusion-xl-base-1.0" --train_data_dir="/kaggle/working/results/img" --reg_data_dir="/kaggle/working/results/reg" --resolution="1024,1024" --output_dir="/kaggle/working/results/model" --logging_dir="/kaggle/working/results/log" --network_alpha="1" --save_model_as=safetensors --network_module=networks.lora --text_encoder_lr=0.0004 --unet_lr=0.0004 --network_dim=32 --output_name="kaggle_glpr123" --lr_scheduler_num_cycles="8" --no_half_vae --learning_rate="0.0004" --lr_scheduler="constant" --train_batch_size="1" --max_train_steps="6400" --save_every_n_epochs="1" --mixed_precision="fp16" --save_precision="fp16" --cache_latents --optimizer_type="Adafactor" --optimizer_args scale_parameter=False relative_step=False warmup_init=False --max_data_loader_n_workers="0" --bucket_reso_steps=64 --full_fp16 --xformers --bucket_no_upscale --noise_offset=0.0 --lowram --max_grad_norm=0.0

@Dr. Furkan Gözükara my dataset is 512px x 768px and I have trained max resolution 768px. Any partic

Similar Threads