Software Engineering Courses (SECourses)•6mo ago

well i didnt test to many times

FFurkan Gözükara SECourses well i didnt test to many times

AiInfluence•7/20/25, 3:37 PM

im closing my h100 soon

AiInfluence•7/20/25, 3:37 PM

get ready to test

AiInfluence•7/20/25, 3:37 PM

thanks

Furkan Gözükara SECoursesOP•7/20/25, 3:38 PM

so your h100 failing at sage attention?

Furkan Gözükara SECoursesOP•7/20/25, 3:38 PM

or what error you getting

AiInfluence•7/20/25, 3:38 PM

no h100 good but c10 error

AiInfluence•7/20/25, 3:38 PM

on first launch

AiInfluence•7/20/25, 3:38 PM

underdog•7/20/25, 11:42 PM

@Furkan Gözükara SECourses Hello,

I was wondering if you have a python code that I can refer/modify for finetuning instead of using the kohya gui? I want to load the parameters and train without having to open the interface and load the parameters all the time.

Uunderdog <@205854764540362752> Hello, I was wondering if you have a python code that I c...

Furkan Gözükara SECoursesOP•7/21/25, 12:49 AM

gui runs cmd code literally

Furkan Gözükara SECoursesOP•7/21/25, 12:50 AM

pay attention to cmd

underdog•7/21/25, 1:09 AM

Yeah, I tried it, but the results I get vary. However, from the GUI, I get good results. I’ll check if the code uses the correct parameters again.

Uunderdog Yeah, I tried it, but the results I get vary. However, from the GUI, I get good ...

Furkan Gözükara SECoursesOP•7/21/25, 1:20 AM

ye kohya is based on cmd command

Furkan Gözükara SECoursesOP•7/21/25, 1:20 AM

so you need to make it accurate

underdog•7/21/25, 2:33 AM

I was able to get it working.

Also kohya does not support chroma finetuning do you know any other open source model that supports chroma finetuning?

Uunderdog I was able to get it working. Also kohya does not support chroma finetuning do...

Furkan Gözükara SECoursesOP•7/21/25, 9:36 AM

check this out : https://github.com/ostris/ai-toolkit

GitHub

GitHub - ostris/ai-toolkit: The ultimate training toolkit for finet...

The ultimate training toolkit for finetuning diffusion models - ostris/ai-toolkit

Furkan Gözükara SECoursesOP•7/21/25, 9:36 AM

i am not sure though

Uunderdog I was able to get it working. Also kohya does not support chroma finetuning do...

Furkan Gözükara SECoursesOP•7/21/25, 9:36 AM

also make a reply here

Furkan Gözükara SECoursesOP•7/21/25, 9:36 AM

https://github.com/kohya-ss/sd-scripts/issues/2081

GitHub

Chroma Support ? · Issue #2081 · kohya-ss/sd-scripts

With the FLUX.1-schnell based Chroma model gaining popularity is there any chance of it being added, for lora trainng ?

underdog•7/21/25, 9:37 AM

I tried ai tool kit but I could only find lora training. I will check again.

underdog•7/21/25, 9:48 AM

"I’d like to support this request. It would be beneficial if the developers could add support for the Chroma model.

Chroma is an 8.9B parameter model based on FLUX.1-schnell. More information can be found here: huggingface.co/lodestones/Chroma

Additionally, ai-toolkit and the diffusion-pipe project at github.com/tdrussell/diffusion-pipe already supports Chroma. (LoRA/fine-tuning).

Thank you for the fantastic sd-scripts project; your work is greatly appreciated!"

I came across this comment by blackmagix24. I will give diffusion pipe a shot. if you happen to test it in the future, I would love to see a video from you for chroma fine tuning along with a comparison with flux dev

Uunderdog "I’d like to support this request. It would be beneficial if the developers coul...

Furkan Gözükara SECoursesOP•7/21/25, 9:50 AM

it is just weaker

Furkan Gözükara SECoursesOP•7/21/25, 9:50 AM

what makes flux different is that it is literally built to make money

Furkan Gözükara SECoursesOP•7/21/25, 9:50 AM

so it is really good

underdog•7/21/25, 9:51 AM

yeah, when I tried chroma the images weren't as good as flux dev, but on the bright side chroma has apache license and I was wondering if finetuned well, will the results be in par with flux dev.

Uunderdog yeah, when I tried chroma the images weren't as good as flux dev, but on the bri...

Furkan Gözükara SECoursesOP•7/21/25, 12:42 PM

kohya adding it

Furkan Gözükara SECoursesOP•7/21/25, 12:42 PM

https://github.com/kohya-ss/sd-scripts/pull/2157

GitHub

Feature Chroma support by kohya-ss · Pull Request #2157 · kohya-s...

Thank you lodestones for the high quality model.
--model_type option is added to flux_train_network.py. For Chroma, --model_type chroma is required.
According to lodestones, --apply_t5_attn_mask --...

Le_Docteur•7/21/25, 4:20 PM

Mister Doctor, if i am to train on another SDXL model with baked vae, should i delete additional vae from preset? Tier1_48_GB_Faster_v2

this one
VAE (Optional: Path to checkpoint of vae for training)
stabilityai/sdxl-vae

LLe_Docteur Mister Doctor, if i am to train on another SDXL model with baked vae, should i d...

Furkan Gözükara SECoursesOP•7/21/25, 4:43 PM

yes delete

FFurkan Gözükara SECourses yes delete

Le_Docteur•7/21/25, 4:58 PM

thank you
and if i do batch size=2, do i need to adjust learning rates? like double them

LLe_Docteur thank you and if i do batch size=2, do i need to adjust learning rates? like dou...

Furkan Gözükara SECoursesOP•7/21/25, 5:43 PM

yes

Furkan Gözükara SECoursesOP•7/21/25, 5:43 PM

try square root of batch size

minaricrew_10803•7/22/25, 3:35 AM

Hi! I just downloaded Kohya and all necessary models in my Runpod. How can I use best configs json file(e.g. 48GB_GPU_Quality_Tier_1_40000MB_9.3_Second_IT_Trains_T5_and_T5_Attention) in Kohya?

Should I manually put all the parameters?

minaricrew_10803•7/22/25, 4:38 AM

And I tried this config with L40S, but keep shows "torch.OutOfMemoryError: CUDA out of memory. Tried to allocate 72.00 MiB.
GPU 0 has a total capacity of 44.52 GiB of which 24.25 MiB is free.
Process 165082 has 44.49 GiB memory in use."

250718_inpyo_15_20250722-041950.json6.2KB

Mminaricrew_10803 And I tried this config with L40S, but keep shows "torch.OutOfMemoryError: CUDA ...

Furkan Gözükara SECoursesOP•7/22/25, 11:12 AM

yes use lesser config

Furkan Gözükara SECoursesOP•7/22/25, 11:12 AM

probably your images are not all 1024x1024

minaricrew_10803•7/22/25, 12:27 PM

I just checked and it's all 1024 * 1024. Is there any possibility that I'm facing OOM even though I'm using L40S(And I checked the memory usage right before the training)

Mminaricrew_10803 I just checked and it's all 1024 * 1024. Is there any possibility that I'm facin...

Furkan Gözükara SECoursesOP•7/22/25, 12:31 PM

well it uses 40 GB so you shouldnt

Furkan Gözükara SECoursesOP•7/22/25, 12:31 PM

can you try restart machine and try again?

Furkan Gözükara SECoursesOP•7/22/25, 12:31 PM

but maybe kohya made some updates and now it uses more VRAM

minaricrew_10803•7/22/25, 12:35 PM

I'll try and let you know!

minaricrew_10803•7/22/25, 11:47 PM

@Furkan Gözükara SECourses When I change config to "cache_latents = false / cache_latents_to_disk = false", GPU usage dropped to 36GB. Is there any quality drop if I change it like this?

Mminaricrew_10803 <@205854764540362752> When I change config to "cache_latents = false / cache_lat...

Furkan Gözükara SECoursesOP•7/23/25, 12:53 AM

nope

zadkhamaya•7/23/25, 2:12 AM

Hi @Furkan Gözükara SECourses
Thank you for the dreambooth training tutorial, it really very clear and I successfully manage the training for a person and it performs really well

I have question for other case, if I want to train a person with specific clothing style and also in a specific illustration style, what will be the best approach? Shall I train first the illustration style, then the person with his specific clothing style? The aim is I want to generate this person in consistent clothing style and in consistent illustration style.

Thank you

Zzadkhamaya Hi <@205854764540362752> Thank you for the dreambooth training tutorial, it rea...

Furkan Gözükara SECoursesOP•7/23/25, 2:22 AM

for illustration style use kontext model

Furkan Gözükara SECoursesOP•7/23/25, 2:22 AM

it really does good job

Furkan Gözükara SECoursesOP•7/23/25, 2:23 AM

for clothing if you have pictures of person with that clothing

Furkan Gözükara SECoursesOP•7/23/25, 2:23 AM

that would be great to train

Furkan Gözükara SECoursesOP•7/23/25, 2:23 AM

otherwise you can try to train with cloth pictures

Furkan Gözükara SECoursesOP•7/23/25, 2:23 AM

or traing a clothing model and inpaint images of person

well i didnt test to many times

Similar Threads