Hi I'm trying to train an SD1.5 model with my face on Kohya SS Dreambooth (checkpoint training, not
Hi I'm trying to train an SD1.5 model with my face on Kohya SS Dreambooth (checkpoint training, not lora) and wanted to see what settings you would recommend. Appreciate it! Here is my current setup:
CPU: AMD 5900x (12core/24processors)
GPU: RTX 3090 (24gb vram)
RAM: 16GB
Training images: 16 images / 40 repeat
Regularization images: 5200 images from your patreon post / 1 repeat
Image size: 768 x 1024
Kohya setting:
accelerate launch
--num_cpu_threads_per_process=24 "./train_db.py"
--pretrained_model_name_or_path="C:/Users/foodmass/Stable-diffusion/t3_Ver09.safetensors"
--train_data_dir="C:/Users/foodmass/Documents/asdf-t3-v2\img"
--reg_data_dir="C:/Users/foodmass/Documents/asdf-t3-v2\reg"
--resolution="768,1024"
--output_dir="C:/Users/foodmass/Documents/asdf-t3-v2\model"
--logging_dir="C:/Users/foodmass/Documents/asdf-t3-v2\log"
--save_model_as=safetensors
--full_bf16
--output_name="asdf"
--lr_scheduler_num_cycles="8"
--max_data_loader_n_workers="1"
--learning_rate_te="1e-06"
--learning_rate="0.0001"
--lr_scheduler="constant"
--train_batch_size="4"
--max_train_steps="2560"
--save_every_n_epochs="1"
--mixed_precision="bf16"
--save_precision="bf16"
--cache_latents
--optimizer_type="Adafactor"
--max_data_loader_n_workers="1"
--clip_skip=2
--bucket_reso_steps=64
--gradient_checkpointing
--xformers
--bucket_no_upscale
--noise_offset=0.0
CPU: AMD 5900x (12core/24processors)
GPU: RTX 3090 (24gb vram)
RAM: 16GB
Training images: 16 images / 40 repeat
Regularization images: 5200 images from your patreon post / 1 repeat
Image size: 768 x 1024
Kohya setting:
accelerate launch
--num_cpu_threads_per_process=24 "./train_db.py"
--pretrained_model_name_or_path="C:/Users/foodmass/Stable-diffusion/t3_Ver09.safetensors"
--train_data_dir="C:/Users/foodmass/Documents/asdf-t3-v2\img"
--reg_data_dir="C:/Users/foodmass/Documents/asdf-t3-v2\reg"
--resolution="768,1024"
--output_dir="C:/Users/foodmass/Documents/asdf-t3-v2\model"
--logging_dir="C:/Users/foodmass/Documents/asdf-t3-v2\log"
--save_model_as=safetensors
--full_bf16
--output_name="asdf"
--lr_scheduler_num_cycles="8"
--max_data_loader_n_workers="1"
--learning_rate_te="1e-06"
--learning_rate="0.0001"
--lr_scheduler="constant"
--train_batch_size="4"
--max_train_steps="2560"
--save_every_n_epochs="1"
--mixed_precision="bf16"
--save_precision="bf16"
--cache_latents
--optimizer_type="Adafactor"
--max_data_loader_n_workers="1"
--clip_skip=2
--bucket_reso_steps=64
--gradient_checkpointing
--xformers
--bucket_no_upscale
--noise_offset=0.0
