Software Engineering Courses (SECourses)•13mo ago

why multires? they're all the same res, 2048px

�

Question: If I launch massedcompute with 2 a6000, can I run two trainings at the same time on that machine? @Furkan Gözükara SECourses

�🍭🎀 𝒜𝓋𝒶 𝐹𝓇𝒾𝑔𝑔 🎀🍭why multires? they're all the same res, 2048px

XCogni•12/6/24, 1:01 PM

no train your 2048px images at 1024x1024 with bucket

but also train them at 512x and 768x

at least for me provides better results

�

🍭🎀 𝒜𝓋𝒶 𝐹𝓇𝒾𝑔𝑔 🎀🍭OP•12/6/24, 1:02 PM

oh, never messed with those settings

SSaïasan Hello any tips for training/finetuning flux with a logo or can I train It the sa...

Furkan Gözükara SECourses•12/6/24, 1:24 PM

exactly same way

Furkan Gözükara SECourses•12/6/24, 1:24 PM

jut dataset matters

�🍭🎀 𝒜𝓋𝒶 𝐹𝓇𝒾𝑔𝑔 🎀🍭Question: If I launch massedcompute with 2 a6000, can I run two trainings at the...

Furkan Gözükara SECourses•12/6/24, 1:25 PM

yes

Furkan Gözükara SECourses•12/6/24, 1:25 PM

i run 8 trainings on a single machine

Furkan Gözükara SECourses•12/6/24, 1:25 PM

8 gpus

�

🍭🎀 𝒜𝓋𝒶 𝐹𝓇𝒾𝑔𝑔 🎀🍭OP•12/6/24, 2:03 PM

hm, but when starting the second isntance of kohya, should I use the same command in the terminal? or navigate to kohya ss folder in apps and run ./gui.sh, I went with option 1 while the first training already had started, hope I don't ruin anything

�

🍭🎀 𝒜𝓋𝒶 𝐹𝓇𝒾𝑔𝑔 🎀🍭OP•12/6/24, 2:07 PM

you select the same folder for output for the 2nd training? diffusion models inside swarmui? or will that cause conflict

FFurkan Gözükara SECourses jut dataset matters

Saïasan•12/6/24, 2:11 PM

Thanks

�🍭🎀 𝒜𝓋𝒶 𝐹𝓇𝒾𝑔𝑔 🎀🍭hm, but when starting the second isntance of kohya, should I use the same comman...

Furkan Gözükara SECourses•12/6/24, 2:12 PM

as long as they are on different port

Furkan Gözükara SECourses•12/6/24, 2:12 PM

it will work

Furkan Gözükara SECourses•12/6/24, 2:12 PM

also just set different gpu id

Furkan Gözükara SECourses•12/6/24, 2:12 PM

in accelerator

�

🍭🎀 𝒜𝓋𝒶 𝐹𝓇𝒾𝑔𝑔 🎀🍭OP•12/6/24, 2:12 PM

yes, I found that option, set gpu id 1 on the second training

�

🍭🎀 𝒜𝓋𝒶 𝐹𝓇𝒾𝑔𝑔 🎀🍭OP•12/6/24, 2:13 PM

both are running now, I went with a different folder for the 2nd training, just diffusion_models2 to be sure they don't get mixed up

�

🍭🎀 𝒜𝓋𝒶 𝐹𝓇𝒾𝑔𝑔 🎀🍭OP•12/6/24, 2:14 PM

Running smoothly

�🍭🎀 𝒜𝓋𝒶 𝐹𝓇𝒾𝑔𝑔 🎀🍭both are running now, I went with a different folder for the 2nd training, just ...

Furkan Gözükara SECourses•12/6/24, 2:18 PM

ye use different image folders

Furkan Gözükara SECourses•12/6/24, 2:18 PM

or 1 overwrites others cache

�

🍭🎀 𝒜𝓋𝒶 𝐹𝓇𝒾𝑔𝑔 🎀🍭OP•12/6/24, 2:18 PM

yeah, luckily I thought so before I started the 2nd one

�

🍭🎀 𝒜𝓋𝒶 𝐹𝓇𝒾𝑔𝑔 🎀🍭OP•12/8/24, 4:45 PM

Uploaded checkpoints and pics using the huggingface script, but having all those pics in the same directory as the models became very annoying, how to I delete all pics from the huggingface directory?

�🍭🎀 𝒜𝓋𝒶 𝐹𝓇𝒾𝑔𝑔 🎀🍭Uploaded checkpoints and pics using the huggingface script, but having all those...

Furkan Gözükara SECourses•12/8/24, 5:12 PM

sadly i dont know how to delete all try llms

�

🍭🎀 𝒜𝓋𝒶 𝐹𝓇𝒾𝑔𝑔 🎀🍭OP•12/8/24, 5:15 PM

ok, I don't really need hugging for pics anyways, it's really for models

�

🍭🎀 𝒜𝓋𝒶 𝐹𝓇𝒾𝑔𝑔 🎀🍭OP•12/9/24, 10:08 AM

Getting error using cropper on the newest version of ultimate img batch crop/resize, it can't save the files...using massedcompute. Write Error

�🍭🎀 𝒜𝓋𝒶 𝐹𝓇𝒾𝑔𝑔 🎀🍭Getting error using cropper on the newest version of ultimate img batch crop/res...

Furkan Gözükara SECourses•12/9/24, 10:55 AM

let me test

Furkan Gözükara SECourses•12/9/24, 10:55 AM

on windows i didnt have errors

�

🍭🎀 𝒜𝓋𝒶 𝐹𝓇𝒾𝑔𝑔 🎀🍭OP•12/9/24, 10:56 AM

one of the files had format jiff, might that be the reason for the error?

�🍭🎀 𝒜𝓋𝒶 𝐹𝓇𝒾𝑔𝑔 🎀🍭one of the files had format jiff, might that be the reason for the error?

Furkan Gözükara SECourses•12/9/24, 10:56 AM

yep

Furkan Gözükara SECourses•12/9/24, 10:56 AM

pngs working?

�

🍭🎀 𝒜𝓋𝒶 𝐹𝓇𝒾𝑔𝑔 🎀🍭OP•12/9/24, 10:57 AM

I used an earlier version of your program on my pc instead of massed, it completed the process, and just ignored the jiff file

Furkan Gözükara SECourses•12/9/24, 10:57 AM

it is jiff or jfif?

Furkan Gözükara SECourses•12/9/24, 10:57 AM

i dont know jiff format

�

🍭🎀 𝒜𝓋𝒶 𝐹𝓇𝒾𝑔𝑔 🎀🍭OP•12/9/24, 10:57 AM

looks like the new version doesnt ignore it, but stops the whole thing

�

🍭🎀 𝒜𝓋𝒶 𝐹𝓇𝒾𝑔𝑔 🎀🍭OP•12/9/24, 10:57 AM

ah yeah, jfif probably

Furkan Gözükara SECourses•12/9/24, 10:58 AM

please verify extension for me

Furkan Gözükara SECourses•12/9/24, 10:58 AM

so i can try to fix

�

🍭🎀 𝒜𝓋𝒶 𝐹𝓇𝒾𝑔𝑔 🎀🍭OP•12/9/24, 10:58 AM

ok sec

�

🍭🎀 𝒜𝓋𝒶 𝐹𝓇𝒾𝑔𝑔 🎀🍭OP•12/9/24, 10:58 AM

it is jfif

�

🍭🎀 𝒜𝓋𝒶 𝐹𝓇𝒾𝑔𝑔 🎀🍭OP•12/9/24, 10:59 AM

there was also a webp pic in the folder, but that format works fine

�🍭🎀 𝒜𝓋𝒶 𝐹𝓇𝒾𝑔𝑔 🎀🍭it is jfif

Furkan Gözükara SECourses•12/9/24, 11:07 AM

on windows jfif works

Furkan Gözükara SECourses•12/9/24, 11:07 AM

i wonder if your image is broken

�🍭🎀 𝒜𝓋𝒶 𝐹𝓇𝒾𝑔𝑔 🎀🍭ok sec

Furkan Gözükara SECourses•12/9/24, 11:31 AM

the error is yolo not supporting

Furkan Gözükara SECourses•12/9/24, 11:31 AM

'pfm', 'mpo', 'jpg', 'jpeg', 'webp', 'tif', 'dng', 'png', 'bmp', 'heic', 'tiff'

�

🍭🎀 𝒜𝓋𝒶 𝐹𝓇𝒾𝑔𝑔 🎀🍭OP•12/9/24, 11:55 AM

ok thank you Dr.

�🍭🎀 𝒜𝓋𝒶 𝐹𝓇𝒾𝑔𝑔 🎀🍭ok thank you Dr.

Furkan Gözükara SECourses•12/9/24, 12:07 PM

i am gonna make a fix

�

🍭🎀 𝒜𝓋𝒶 𝐹𝓇𝒾𝑔𝑔 🎀🍭OP•12/9/24, 12:10 PM

I am missing the ae.safetensors for flux dev, is this the right one? https://huggingface.co/black-forest-labs/FLUX.1-schnell/blob/main/ae.safetensors says flux schnell, but the vae is the same, ye?

ae.safetensors · black-forest-labs/FLUX.1-schnell at main

�

🍭🎀 𝒜𝓋𝒶 𝐹𝓇𝒾𝑔𝑔 🎀🍭OP•12/9/24, 12:15 PM

tried use the download models again, but it starts downloading flux dev etc. all over again

�🍭🎀 𝒜𝓋𝒶 𝐹𝓇𝒾𝑔𝑔 🎀🍭I am missing the ae.safetensors for flux dev, is this the right one? https://hug...

Furkan Gözükara SECourses•12/9/24, 12:32 PM

yes

�

🍭🎀 𝒜𝓋𝒶 𝐹𝓇𝒾𝑔𝑔 🎀🍭OP•12/9/24, 12:37 PM

Got error on start of training, I have not gotten this error before. done 20 trainings and no problems starting:
"024-12-09 12:23:35 INFO Loading state dict from flux_utils.py:330
/home/Ubuntu/Downloads/t5xxl_fp16
.safetensors
Traceback (most recent call last):
File "/home/Ubuntu/apps/kohya_ss/sd-scripts/library/utils.py", line 366, in load_safetensors
state_dict = load_file(path, device=device)
File "/home/Ubuntu/apps/kohya_ss/venv/lib/python3.10/site-packages/safetensors/torch.py", line 313, in load_file
with safe_open(filename, framework="pt", device=device) as f:
safetensors_rust.SafetensorError: Error while deserializing header: MetadataIncompleteBuffer

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/home/Ubuntu/apps/kohya_ss/sd-scripts/flux_train.py", line 849, in <module>
train(args)
File "/home/Ubuntu/apps/kohya_ss/sd-scripts/flux_train.py", line 222, in train
t5xxl = flux_utils.load_t5xxl(args.t5xxl, weight_dtype, "cpu", args.disable_mmap_load_safetensors)
File "/home/Ubuntu/apps/kohya_ss/sd-scripts/library/flux_utils.py", line 331, in load_t5xxl
sd = load_safetensors(ckpt_path, device=str(device), disable_mmap=disable_mmap, dtype=dtype)
File "/home/Ubuntu/apps/kohya_ss/sd-scripts/library/utils.py", line 368, in load_safetensors
state_dict = load_file(path) # prevent device invalid Error
File "/home/Ubuntu/apps/kohya_ss/venv/lib/python3.10/site-packages/safetensors/torch.py", line 313, in load_file
"

why multires? they're all the same res, 2048px

Similar Threads