So this error was because of different resolutions? If I use all images with 1024x1024 now (no bucke

DD4UNTLESS So this error was because of different resolutions? If I use all images with 102...

F

Furkan Gözükara SECourses•12/22/24, 4:39 PM

yes

F

Furkan Gözükara SECourses•12/22/24, 4:39 PM

it was using more vram

FFurkan Gözükara SECourses yes

D

D4UNTLESSOP•12/22/24, 6:18 PM

ok thanks! I'll try again after a few hours

J

johnasdf.•12/22/24, 6:54 PM

Has anyone gotten this message when fine-tuning a Flux model? ValueError: mutable default <class 'timm.models.maxxvit.MaxxVitConvCfg'> for field conv_cfg is not allowed: use default_factory

Jjohnasdf.Has anyone gotten this message when fine-tuning a Flux model? ValueError: mutab...

F

Furkan Gözükara SECourses•12/22/24, 6:58 PM

which model ?

J

johnasdf.•12/22/24, 6:59 PM

Initially I fine-tuned with AGFlux_v21, a de-distilled model. Now I am trying to take a second pass on it.

J

johnasdf.•12/22/24, 7:02 PM

ChatGPT thinks it's either timm, Torch, or Kohya

J

johnasdf.•12/22/24, 7:04 PM

I noticed there are two venvs created when I ran the kohya setup v17... venv, and venv3. Is that what was intended to happen?

Jjohnasdf.Initially I fine-tuned with AGFlux_v21, a de-distilled model. Now I am trying to...

F

Furkan Gözükara SECourses•12/22/24, 7:06 PM

report to kohya

F

Furkan Gözükara SECourses•12/22/24, 7:06 PM

some models are not supported

J

johnasdf.•12/22/24, 7:07 PM

But I fine-tuned the model a few weeks ago, and then I just downloaded it from my huggingface account.

Jjohnasdf.But I fine-tuned the model a few weeks ago, and then I just downloaded it from m...

F

Furkan Gözükara SECourses•12/22/24, 7:07 PM

in that case

F

Furkan Gözükara SECourses•12/22/24, 7:08 PM

try model on swarmui

F

Furkan Gözükara SECourses•12/22/24, 7:08 PM

see if working

J

johnasdf.•12/22/24, 7:38 PM

Yeah. it works

J

johnasdf.•12/22/24, 7:52 PM

I got it to work. I just needed to upgrade timm to the latest version, which is 1.0.12. It had installed 0.6.12. If you want to update the Runpod installer.

J

johnasdf.•12/22/24, 7:54 PM

When you trained the de-distilled model did you use guidance > 1?

Jjohnasdf.When you trained the de-distilled model did you use guidance > 1?

F

Furkan Gözükara SECourses•12/22/24, 10:23 PM

yes

F

Furkan Gözükara SECourses•12/22/24, 10:23 PM

use 3.5 i think it was best

J

johnasdf.•12/22/24, 10:35 PM

Thank you

FFurkan Gözükara SECourses yes

D

D4UNTLESSOP•12/22/24, 11:53 PM

Thanks for the help! Last time I got an error at 32 steps.
I combined padding & cropping to bring all my images to 1014x1024. I used batch 7 config and last time I checked (1 hour ago), it was already at 250 steps

DD4UNTLESS Thanks for the help! Last time I got an error at 32 steps. I combined padding & ...

F

Furkan Gözükara SECourses•12/23/24, 12:35 AM

great

F

Furkan Gözükara SECourses•12/23/24, 12:35 AM

250 steps = 250 *7 samples

F

Furkan Gözükara SECourses•12/23/24, 12:36 AM

1750 steps at batch size 1

C

ctz00•12/23/24, 6:26 AM

hi, i am doing character training in sdxl dreambooth in kohya but the results are like this:

C

ctz00•12/23/24, 6:26 AM

C

ctz00•12/23/24, 6:27 AM

--save_model_as="safetensors" \
--full_bf16 \
--output_name="momo_sdxl_dreambooth" \
--lr_scheduler_num_cycles=8 \
--max_data_loader_n_workers=0 \
--learning_rate=1e-04 \
--lr_scheduler="constant" \
--train_batch_size=1 \
--max_train_steps=10000 \
--save_every_n_steps=500 \
--mixed_precision="bf16" \
--save_precision="bf16" \
--cache_latents \
--cache_latents_to_disk  \
--optimizer_type="Adafactor" \
--optimizer_args \
--bucket_reso_steps=64 \
--noise_offset=0.0 \
--gradient_checkpointing \
--bucket_no_upscale \
--train_text_encoder \
--sample_every_n_epochs=1 \
--sample_every_n_steps=500 \
--sample_sampler="euler" \

--save_model_as="safetensors" \
--full_bf16 \
--output_name="momo_sdxl_dreambooth" \
--lr_scheduler_num_cycles=8 \
--max_data_loader_n_workers=0 \
--learning_rate=1e-04 \
--lr_scheduler="constant" \
--train_batch_size=1 \
--max_train_steps=10000 \
--save_every_n_steps=500 \
--mixed_precision="bf16" \
--save_precision="bf16" \
--cache_latents \
--cache_latents_to_disk  \
--optimizer_type="Adafactor" \
--optimizer_args \
--bucket_reso_steps=64 \
--noise_offset=0.0 \
--gradient_checkpointing \
--bucket_no_upscale \
--train_text_encoder \
--sample_every_n_epochs=1 \
--sample_every_n_steps=500 \
--sample_sampler="euler" \

--save_model_as="safetensors" \
--full_bf16 \
--output_name="momo_sdxl_dreambooth" \
--lr_scheduler_num_cycles=8 \
--max_data_loader_n_workers=0 \
--learning_rate=1e-04 \
--lr_scheduler="constant" \
--train_batch_size=1 \
--max_train_steps=10000 \
--save_every_n_steps=500 \
--mixed_precision="bf16" \
--save_precision="bf16" \
--cache_latents \
--cache_latents_to_disk  \
--optimizer_type="Adafactor" \
--optimizer_args \
--bucket_reso_steps=64 \
--noise_offset=0.0 \
--gradient_checkpointing \
--bucket_no_upscale \
--train_text_encoder \
--sample_every_n_epochs=1 \
--sample_every_n_steps=500 \
--sample_sampler="euler" \

--save_model_as="safetensors" \
--full_bf16 \
--output_name="momo_sdxl_dreambooth" \
--lr_scheduler_num_cycles=8 \
--max_data_loader_n_workers=0 \
--learning_rate=1e-04 \
--lr_scheduler="constant" \
--train_batch_size=1 \
--max_train_steps=10000 \
--save_every_n_steps=500 \
--mixed_precision="bf16" \
--save_precision="bf16" \
--cache_latents \
--cache_latents_to_disk  \
--optimizer_type="Adafactor" \
--optimizer_args \
--bucket_reso_steps=64 \
--noise_offset=0.0 \
--gradient_checkpointing \
--bucket_no_upscale \
--train_text_encoder \
--sample_every_n_epochs=1 \
--sample_every_n_steps=500 \
--sample_sampler="euler" \

`

C

ctz00•12/23/24, 6:27 AM

how to cure?

Cctz00 hi, i am doing character training in sdxl dreambooth in kohya but the results ar...

F

Furkan Gözükara SECourses•12/23/24, 8:49 AM

hi follow this video every step : https://youtu.be/0t5l6CP9eBg

YouTubeSECourses

Full Stable Diffusion SD & XL Fine Tuning Tutorial With OneTrainer ...

In this tutorial, I am going to show you how to install OneTrainer from scratch on your computer and do a Stable Diffusion SDXL (Full Fine-Tuning 10.3 GB VRAM) and SD 1.5 (Full Fine-Tuning 7GB VRAM) based models training on your computer and also do the same training on a very cheap cloud machine from MassedCompute if you don't have such compute...

F

Furkan Gözükara SECourses•12/23/24, 8:49 AM

it shows configs

T

Timson•12/23/24, 11:29 AM

@Furkan Gözükara SECourses how does new L40 compares to A6000 on training tasks?

TTimson <@205854764540362752> how does new L40 compares to A6000 on training tasks?

F

Furkan Gözükara SECourses•12/23/24, 12:04 PM

little bit faster

F

Furkan Gözükara SECourses•12/23/24, 12:04 PM