1.2 it is good speed for RTX 4090 and SDXL
1.2 it is good speed for RTX 4090 and SDXL
Dmay be It was 1.4/it but oround that speed
Dmy card is a 3090
DI hade slightly better speed on windows 10 0.1 it/s better
Fah you must be using xformers
Fi think it reduces quality slightly
Dyes I think you right
NWhat's the new parameter
Fprobably for turbo model
D
D1e_04_fp8_bf16_accelerate_full_bf16_32_rank config
Dsomething is not right
Dis consuming too much vram
D
Done thing I saw yesterday was that no matter the lora rank I use the vram usage was the same
Dlora rank 32
Dlora rank 128 is consuming less vram??? what??
Dmust be a bug
Flora rank impact on VRAM is very minimal i tested
Fhow much vram usage you have before starting the training?
D0.6
DI can turn off the monitors and get 0.4 gb
F0.6 should work but still using some extra. i wonder if due to operating system
Fi tested vram usages on ubuntu
Dbut yesterday worked
Finteresting
Fare you using latest version?
Fof kohya
DI cant remenber what was diferent
Dit was rank 8
Dnow is working rank 8
D
Dfor Network Rank (Dimension) 8 I need to set Convolution Rank (Dimension) to 8 too?
Dand what about Network Alpha and Convolution Alpha?
Dyes I did a git pull before training
DI'm going to test your lowest_vram config now
DNow is working with your 1e_04_fp8_bf16_accelerate_full_bf16_32_rank config, I just restarted the PC and enabled buckets not all my images are 1024x1024 is working with great speed
Dthat was with my monitors turned off but I need to use my pc for other tasks, using the pc the speed decreased
�Is 200 epochs per image really necessary tho? 387 images in your dataset and training will be finished like in 4 days lol 
Dhehe yes
DI can stop it earlier and test
Dbut yes is too slow
![Dazzastrous [4090]](https://cdn.discordapp.com/avatars/871389071686135838/c4a5f4d81d9eeb18d856295d692e2c07.webp?size=40)
Dany idea why my comp completely freezes when trying to install Dlib in conda?
FConvolution Rank is for other lora types as far as i know
Fmake network rank 8 and alpha 8
Fnope i am doing big test
Fi will aim 100-150 epoch
Fi have 15 classic dataset
![Dazzastrous [4090]](https://cdn.discordapp.com/avatars/871389071686135838/c4a5f4d81d9eeb18d856295d692e2c07.webp?size=16)