To train Dreambooth, 24GB_GPU_23150MB_10.2_second_it_Tier_1.json with Doc V9 achieves 9.47s/it. It
To train Dreambooth, 24GB_GPU_23150MB_10.2_second_it_Tier_1.json with Doc V9 achieves 9.47s/it. It runs stable and smoothly.
Zwell, it depends on the quality of the dataset
Zfor me, it was fun with one of my sons
Zbecause I included several ages without desciption
Tthats impressive. i've only gotten 12.18/it
Zso, sometimes, its a younger version, especially in earlier epochs
Lwith V9 version?
Zbut right now, with the 2 tiered training, I succesfully fooled his mom (inadvertently)
ZShe asked if it was his school picture, because she would love if he could wear that suit to a weeding next weekend
Zlol
Ti've had ones where for some reason it started with a really old guy with wrinkles and everything, than as it go closer to me, it slowly de-aged him, but still left remnants of the original old guy. Another time it chose another pic and started with a chubby guy, and left remanents of a bigger guy. Its all random, but i think you can get better results based on which person it starts with.
Tyes thats the test of a good lora.. if you can fool you mom, and i did. 
Ti didn't upgrade the 3090, i think its only v8. been trying to get my 2080 working again.. i guess v9 is even faster?
LTry set “Blocks to swap" =9 or 8
LLkeep in mind that the more you lower this value the more VRAM it will consume. Play with values between 7 and 10
F23500MB is a lot . you really need to free up 3090 GPU for it
Fthis one is great and your speed is too
Wsame at my 3090 speed even at that time I dont upgrade to Torch 2.5
Wafter download your newest dreambooth training config, I will test whether speed improve or not
Where is my speed before update
W
Fconfig same only spda changed to xformers
LI noticed that the speed gain is in the best GPU utilization. GPU utilization is at 100% constantly. It's great, but be careful to keep your equipment well cooled. In my case the VRAM temp went up to 94 celsius after 7 hours of training.
DI get like 6s/it on a 4090 and my GPU stays around 60-70C
Lmemory temp and hot spot temp?
L
D
Dthe hotspot temp does max out pretty high but i think thats still safe
LGREATTTT!!!! In my case it is very hot, here we are in spring. If I were in winter it would be nice because my pc gives me a little warmth.
DI just got my air conditioner fixed XD Before that, if I used my 4090 for anything my room would heat up like a sauna
TI think i figured out the 8GB out of memory cuda problem. on torch 2.5, its 1024,1024 resolution runs out of memory, if i drop to 768,768 it works. Any ideas how to get it to run at 1024,1024?
VEither increase page file size or you might need more physical ram. Smaller the vram the more ram needed.
Fgreat speed
Fit should work weird
Fincrease block swap count
TI think its torch 2.5 it works on 2.4 - but slow. increase block swap to 36 didn't help. But that was the culprit 1024 vs 768. Must just be slightly short vram. Or have something to do with source images being PNG? is your set jpg?
Fno image doesnt matter
Ftorch 2.4 works but way slower
Fso maybe that is why
TI am trying with a smaller source image set to see if makes a difference. 15 vs 30 images.
Tso even with 5 images 1024/1024 fails, but 768/768 works with any number of images on 8GB torch 2.5 . I even changed OS to windows 11 to try to figure out.. maybe its a memory leak in torch 2.5 and older nvidia.
Fvery possible
Fi got to sleep now
TFYI precompiled pytorch - does not require cuda installed on windows. it comes built in.. I have completely removed VS2022 and cuda from my system during troubleshooting
Fcuda is used only when you compile something
Flike insightface
Fxpose
Fetc