you can use bat file
you can use bat file
For this
FFit is experimental remember
Dohh you updated the bat file?
DI'm already on the venv
Nnew bat file in installer zip
Install_Torch_2_5_Dev_Huge_Speed_Up.bat
Install_Torch_2_5_Dev_Huge_Speed_Up.bat
Dthanks
DI will try this pip3 install --pre torch torchvision torchaudio --index-url https://download.pytorch.org/whl/nightly/cu124 --upgrade
Dif it doesent work Ill go with the bat
Dthanks
D
Dis working
Dtried out the Joy captioner and gotta say I'm confused. captions are needlessly long, and I can't give special instructions like "always refer to her as XY" "ignore haircolor and eyecolor" stuff like that.
Nshorten caption by lowering default tokens from 300... agree on special instructions, semi workaround to "always refer to her as XY" is to use batch caption editor and do a replace afterward
https://www.patreon.com/posts/108992085
https://www.patreon.com/posts/108992085
Patreon
Get more from SECourses: Tutorials, Guides, Resources, Training, FLUX, MidJourney, Voice Clone, TTS, ChatGPT, GPT, LLM, Scripts by Furkan Gözü on Patreon
M@Dr. Furkan Gözükara have you tried training with your images higher than 1024? does it reduce likeness for you?
Fi tried
Fshown results on patreon research post
Mcan link to post so i can check
Mthanks sir
FPatreon
Get more from SECourses: Tutorials, Guides, Resources, Training, FLUX, MidJourney, Voice Clone, TTS, ChatGPT, GPT, LLM, Scripts by Furkan Gözü on Patreon
Flook this part
FHigher Resolution Training Impact
Mno i mean like you images itsself not the res on kohya
Mlike say you have 2048x2048 images
and you train at 1024x1024 with buckets
and you train at 1024x1024 with buckets
Mhave you tried that
NI don't think he has used bucketing in any of his flux configs so far
�What would happen if he just went 4K all the way lol
Fi trained
F1280
F1536
Fmy images
BGetting this issue on training on runpod
BTraceback (most recent call last):
File "/workspace/kohya_ss/sd-scripts/flux_train_network.py", line 445, in <module>
trainer.train(args)
File "/workspace/kohya_ss/sd-scripts/train_network.py", line 344, in train
model_version, text_encoder, vae, unet = self.load_target_model(args, weight_dtype, accelerator)
File "/workspace/kohya_ss/sd-scripts/flux_train_network.py", line 85, in load_target_model
clip_l = flux_utils.load_clip_l(args.clip_l, weight_dtype, "cpu", disable_mmap=args.disable_mmap_load_safetensors)
File "/workspace/kohya_ss/sd-scripts/library/flux_utils.py", line 168, in load_clip_l
sd = load_safetensors(ckpt_path, device=str(device), disable_mmap=disable_mmap, dtype=dtype)
File "/workspace/kohya_ss/sd-scripts/library/flux_utils.py", line 39, in load_safetensors
return load_file(path) # prevent device invalid Error
File "/workspace/kohya_ss/venv/lib/python3.10/site-packages/safetensors/torch.py", line 313, in load_file
with safe_open(filename, framework="pt", device=device) as f:
FileNotFoundError: No such file or directory: "/home/Ubuntu/Downloads/clip_l.safetensors"
Traceback (most recent call last):
File "/workspace/kohya_ss/venv/bin/accelerate", line 8, in <module>
sys.exit(main())
File "/workspace/kohya_ss/venv/lib/python3.10/site-packages/accelerate/commands/accelerate_cli.py", line 48, in main
args.func(args)
File "/workspace/kohya_ss/venv/lib/python3.10/site-packages/accelerate/commands/launch.py", line 1106, in launch_command
simple_launcher(args)
File "/workspace/kohya_ss/venv/lib/python3.10/site-packages/accelerate/commands/launch.py", line 704, in simple_launcher
raise subprocess.CalledProcessError(returncode=process.returncode, cmd=cmd)
subprocess.CalledProcessError: Command '['/workspace/kohya_ss/venv/bin/python', '/workspace/kohya_ss/sd-scripts/flux_train_network.py', '--config_file', '/workspace/AM/model/config_lora-20240828-180637.toml']' returned non-zero exit status 1.
File "/workspace/kohya_ss/sd-scripts/flux_train_network.py", line 445, in <module>
trainer.train(args)
File "/workspace/kohya_ss/sd-scripts/train_network.py", line 344, in train
model_version, text_encoder, vae, unet = self.load_target_model(args, weight_dtype, accelerator)
File "/workspace/kohya_ss/sd-scripts/flux_train_network.py", line 85, in load_target_model
clip_l = flux_utils.load_clip_l(args.clip_l, weight_dtype, "cpu", disable_mmap=args.disable_mmap_load_safetensors)
File "/workspace/kohya_ss/sd-scripts/library/flux_utils.py", line 168, in load_clip_l
sd = load_safetensors(ckpt_path, device=str(device), disable_mmap=disable_mmap, dtype=dtype)
File "/workspace/kohya_ss/sd-scripts/library/flux_utils.py", line 39, in load_safetensors
return load_file(path) # prevent device invalid Error
File "/workspace/kohya_ss/venv/lib/python3.10/site-packages/safetensors/torch.py", line 313, in load_file
with safe_open(filename, framework="pt", device=device) as f:
FileNotFoundError: No such file or directory: "/home/Ubuntu/Downloads/clip_l.safetensors"
Traceback (most recent call last):
File "/workspace/kohya_ss/venv/bin/accelerate", line 8, in <module>
sys.exit(main())
File "/workspace/kohya_ss/venv/lib/python3.10/site-packages/accelerate/commands/accelerate_cli.py", line 48, in main
args.func(args)
File "/workspace/kohya_ss/venv/lib/python3.10/site-packages/accelerate/commands/launch.py", line 1106, in launch_command
simple_launcher(args)
File "/workspace/kohya_ss/venv/lib/python3.10/site-packages/accelerate/commands/launch.py", line 704, in simple_launcher
raise subprocess.CalledProcessError(returncode=process.returncode, cmd=cmd)
subprocess.CalledProcessError: Command '['/workspace/kohya_ss/venv/bin/python', '/workspace/kohya_ss/sd-scripts/flux_train_network.py', '--config_file', '/workspace/AM/model/config_lora-20240828-180637.toml']' returned non-zero exit status 1.
Fi didnt do bucketing
Fso both images and resolution gui was big
Fdownload file
Fgive its accurate path
Frunpod tutorial coming hopefully very soon editing windows tutorial
Bok great
Fso currently it will be like
F/workspace/clip_l.safetensors
F@B0nd
BOk thank you
Dnative windows, better but still slower than WSl
DI traying with a ridiculously high TE lr to see what's happens
Nhow much does LR affect speed? 1024x1024 images? really hoping I can get your speed now that i've done the dev torch update
DI think none
D1024x1024 images
N387 images... are you trying for a style lora?