can you try with SDPA?
can you try with SDPA?
Fi am testing on linux now to test
Fexact vram
Fyou have shared vram enabled right?
Fye it still uses 7gb vram
TI think it has to do with Torch 2.5? Does it work on windows? Shared VRAM should be enabled, system has 64GB, and Task Manager shows 40GB for GPU Memory (8+32), shared GPU memory shows 32GB
Fyes it works
Ftorch 2.5 and xformers is now official
TWhat else can i try? It worked before, but not after using latest torch and configs.. clean SS install using your scripts
Fye clean and let me know
Fi will also now test on my RTX 3060
TI did try Clean.. This is a clean install.
Fdid you try 6 gb config?
Tyes. also gives out of memory
Fso something wrong in your case
Fthe only changed config is SPDA to xformers
Twith SPDA setting.. RuntimeError: CUDA error: out of memory
CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect.
For debugging consider passing CUDA_LAUNCH_BLOCKING=1
Compile with
CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect.
For debugging consider passing CUDA_LAUNCH_BLOCKING=1
Compile with
TORCH_USE_CUDA_DSAyour computer is the issue in that case
Fbecause we use torch 2.5 for a month like now
Fi am doing a fresh install
Fnormally you shouldnt get OOM
Fwhen shared VRAM enabled
Twhere do you enable shared VRAM?
Fit is by default unless you turned off
Ftry a fresh nvidia driver install
Freset all settings
TCuda installed a driver - should i install cuda first, then the latest studio driver?
Fi think first install latest game ready driver
Fthen dont touch cuda
Fcuda is 12.4 right?
Tyes cuda 12.4
Tokay I'll uninstall all drivers. Install latest studio.. Then Cuda 12.4, then fresh install using v9 SS_kohya, then torch 2.5 upgrade
Tif I don't do torch 2.5 upgrade, it works on 2.4 but at 300s/IT
Tbut no cuda error
Fi think dont reinstall cuda
Fye totally wrong
Fi am about to test on rtx 3060
Ffresh install
Fwhat was your gpu?
Ftest starting
Fye 12 gb config used max 10 gb
F
T2080super 8GB
Fi see
Fi think you should get speed between 50 second to 100 second it cant tell exact
F3060 gets 40 second / it
F
TI was getting 52 approx
F
Fyep sounds good
TAnything else i should do to make it clean.. just did a clean Nvidia studio driver install 565.90. Then will do Cuda, then will run your kohya scripts. Option #1, Option #2, Fix, Torch upgrade.