Software Engineering Courses (SECourses)•10mo ago

Hi <@205854764540362752> I have another question, can I train multi characters in one dreambooth ch

Hi @Furkan Gözükara SECourses I have another question, can I train multi characters in one dreambooth checkpoint together using different active keywords and caption ?

FFurkan Gözükara SECourses you can also make repeat 100 and train 2 epochs

sai_150•3/22/25, 2:54 PM

Should I use any other model instead of sdxl base?

Uumrfarooq Thanks for the response. Here my questions: 1. Do you think this will fix the ...

sai_150•3/22/25, 5:12 PM

Have you tried the Catvton model ? It takes model and clothing images as input and generates model wearing the input clothing

Ssai_150 4. Have you tried the Catvton model ? It takes model and clothing images as inpu...

umrfarooq•3/22/25, 5:19 PM

No, I haven't tried. Thanks for sharing. I will try it now. How was your experience with it? Does it work well with different lightning conditions?

sai_150•3/22/25, 5:34 PM

I've tried Simple Catvton workflow. It may not produce exact matching clothing sometimes(color/pattern mismatch). I've seen videos using some advanced workflow to get an exact clothing match. I haven't tried it yet.

Uumrfarooq No, I haven't tried. Thanks for sharing. I will try it now. How was your experie...

sai_150•3/22/25, 5:35 PM

Please let me know about your experience if you implement it for your usecase

Ssai_150 Please let me know about your experience if you implement it for your usecase

umrfarooq•3/22/25, 5:37 PM

Sure, I will update you after trying it. Thank you.

Wwardensc2 Hi <@205854764540362752> I have another question, can I train multi characters ...

Furkan Gözükara SECourses•3/22/25, 9:46 PM

they bleed

Furkan Gözükara SECourses•3/22/25, 9:46 PM

https://medium.com/@furkangozukara/thoroughly-experimented-with-fine-tuning-dreambooth-training-of-flux-dev-de-distill-pixelwave-13fab8c625bf

Medium

Thoroughly experimented with Fine-Tuning / DreamBooth training of F...

Thoroughly experimented with Fine-Tuning / DreamBooth training of Flux-dev-de-distill, PixelWave v03, Verus Vision and base FLUX Dev model…

Ssai_150 Should I use any other model instead of sdxl base?

Furkan Gözükara SECourses•3/22/25, 9:46 PM

of course you can use

Furkan Gözükara SECourses•3/22/25, 9:46 PM

especially a model that already can generate similar quality / resembling images of what you want

Joshua A•3/23/25, 12:33 AM

@Furkan Gözükara SECourses I am using a 48GB to create some finetuning. I used the 48 config and the learning rate is set at: 0.000004. That seems really low. It's taking about 7 hours on 4500 steps.

FFurkan Gözükara SECourses they bleed

wardensc2OP•3/23/25, 4:15 AM

I mean I train using SDXL not Flux i already saw some lora contain many characters

404_error•3/23/25, 7:52 AM

I saw the tutorial, it is really impossible to train a model with my 4060 8gb and 32gb of ram ?

404_error•3/23/25, 8:02 AM

And on runpod there is an new option to automatcly fine tune a model what do you think ?

JJoshua A <@205854764540362752> I am using a 48GB to create some finetuning. I used the 48...

Furkan Gözükara SECourses•3/23/25, 11:55 AM

yes it is normal

Wwardensc2 I mean I train using SDXL not Flux i already saw some lora contain many characte...

Furkan Gözükara SECourses•3/23/25, 11:56 AM

sdxl is different

4404_error I saw the tutorial, it is really impossible to train a model with my 4060 8gb an...

Furkan Gözükara SECourses•3/23/25, 11:56 AM

yes you need 64 gb

4404_error And on runpod there is an new option to automatcly fine tune a model what do you...

Furkan Gözükara SECourses•3/23/25, 11:56 AM

probably lower quality

Furkan Gözükara SECourses•3/23/25, 11:56 AM

compared to what you can get

FFurkan Gözükara SECourses yes you need 64 gb

404_error•3/23/25, 11:56 AM

fuck..

4404_error fuck..

Furkan Gözükara SECourses•3/23/25, 12:27 PM

you can try this. use fp8 lora

Furkan Gözükara SECourses•3/23/25, 12:27 PM

fp8 base

Furkan Gözükara SECourses•3/23/25, 12:27 PM

it may fit

FFurkan Gözükara SECourses sdxl is different

wardensc2OP•3/23/25, 1:58 PM

So in theory I can use your config of SDXL train multi characters using different caption for each character to get the model understand multi concept right ?

Wwardensc2 So in theory I can use your config of SDXL train multi characters using differen...

Furkan Gözükara SECourses•3/23/25, 2:16 PM

yes

FFurkan Gözükara SECourses it may fit

404_error•3/23/25, 2:44 PM

I can use the fp8 flux model i install with your swarmui installer ?

4404_error I can use the fp8 flux model i install with your swarmui installer ?

Furkan Gözükara SECourses•3/23/25, 2:44 PM

yes it has fp8 flux

404_error•3/23/25, 2:44 PM

I know the difference quality between fp8 and fp16 is not huge when using flux but for a dreambooth traning is it the same ?

Furkan Gözükara SECourses•3/23/25, 2:44 PM

but dont use scaled i am not sure if tht works

Furkan Gözükara SECourses•3/23/25, 2:44 PM

by the way

Furkan Gözükara SECourses•3/23/25, 2:45 PM

latest fine tuning downloader

Furkan Gözükara SECourses•3/23/25, 2:45 PM

downloads fp8 model already

Furkan Gözükara SECourses•3/23/25, 2:45 PM

Furkan Gözükara SECourses•3/23/25, 2:45 PM

we cant train fp8 with dreambooth

Furkan Gözükara SECourses•3/23/25, 2:45 PM

but lora should work fairly fine

Furkan Gözükara SECourses•3/23/25, 2:45 PM

select base fp8 on interface

404_error•3/23/25, 2:46 PM

Ok i will try thanks

Joshua A•3/23/25, 2:57 PM

I am following your extracted LoRA tutorial. However getting an error. I have tried all save percisions and network rank sizes. I have checked V2 and unchecked it. Can seem to get past this error. Happening to 3 different finetunes. So I know it's got to be something I am not seeing.

new_checkpoint["time_embedding.linear_1.weight"] = unet_state_dict["time_embed.0.weight"]
KeyError: 'time_embed.0.weight'

Screenshot_2025-03-23_at_10.55.28_AM.png

JJoshua A I am following your extracted LoRA tutorial. However getting an error. I have tr...

Furkan Gözükara SECourses•3/23/25, 2:58 PM

use this

FFurkan Gözükara SECourses use this

Joshua A•3/23/25, 3:13 PM

Xcorpion•3/23/25, 6:59 PM

how to make a lokr like this? with that net dim, usually kohya only allow to put 100000, https://civitai.com/models/292553?modelVersionId=1568463 (this is the lokr and the creator).

XXcorpion how to make a lokr like this? with that net dim, usually kohya only allow to put...

EClipX•3/23/25, 9:44 PM

you can add it in as an extra argument

EClipX•3/23/25, 9:44 PM

or modify the gui

EEClipX you can add it in as an extra argument

Xcorpion•3/23/25, 10:10 PM

guidance please

EClipX•3/23/25, 10:13 PM

here i updated the file for you, replace it before starting the gui

you should be able to change the values of lokr now

the file to replace is in kohya_gui

lora_gui.py93.35KB

EEClipX here i updated the file for you, replace it before starting the gui you should ...

Xcorpion•3/23/25, 10:23 PM

I did replace, tho it's the same

EClipX•3/23/25, 10:29 PM

did you restart your gui? are you sure you replaced the right file?

EClipX•3/23/25, 10:30 PM

see in that file there is this

)
with gr.Row() as network_row:
network_dim = gr.Slider(
minimum=1,
maximum=9999999999,
label="Network Rank (Dimension)",
value=8,
step=1,
interactive=True,
)
network_alpha = gr.Slider(
minimum=0.00001,
maximum=9999999999,
label="Network Alpha",
value=1,
step=0.00001,
interactive=True,
info="alpha for LoRA weight scaling",
)
with gr.Row(visible=False) as convolution_row:
# locon= gr.Checkbox(label='Train a LoCon instead of a general LoRA (does not support v2 base models) (may not be able to some utilities now)', value=False)
conv_dim = gr.Slider(
minimum=0,
maximum=9999999999,
value=1,
step=1,
label="Convolution Rank (Dimension)",
)
conv_alpha = gr.Slider(
minimum=0,
maximum=9999999999,
value=1,
step=1,
label="Convolution Alpha",
)

EEClipX did you restart your gui? are you sure you replaced the right file?

Xcorpion•3/23/25, 10:52 PM

probably, "kohya_ss\kohya_gui\lora_gui.py" this one right?

Xcorpion•3/23/25, 10:55 PM

https://github.com/KohakuBlueleaf/LyCORIS. I tried to do this, but it gives me errors

Hi <@205854764540362752> I have another question, can I train multi characters in one dreambooth ch

Similar Threads