other problem I'm seeing is speed to replicate one of my sdxl trainings it will increase from a few
other problem I'm seeing is speed to replicate one of my sdxl trainings it will increase from a few days to a couple of months, heheh
NAnother question, is there a list of art styles in flux, tokens to get them
Fcurently it is like 8.3 / 1.8 = 4.6 times slower :d
Fnot that i know
Nwhat are the best ones for Flux right now?
DI was able to train at 1.2 it/s with gradient checkpoint off and tweaking some other options, I thing full bf16 training experimental and some other things I dont remember right now
Dwith sdxl off course
Fhavent tested yet just using default :d
F1.2 it is good speed for RTX 4090 and SDXL
Dmay be It was 1.4/it but oround that speed
Dmy card is a 3090
DI hade slightly better speed on windows 10 0.1 it/s better
Fah you must be using xformers
Fi think it reduces quality slightly
Dyes I think you right
NWhat's the new parameter
Fprobably for turbo model
D
D1e_04_fp8_bf16_accelerate_full_bf16_32_rank config
Dsomething is not right
Dis consuming too much vram
D
Done thing I saw yesterday was that no matter the lora rank I use the vram usage was the same
Dlora rank 32
Dlora rank 128 is consuming less vram??? what??
Dmust be a bug
Flora rank impact on VRAM is very minimal i tested
Fhow much vram usage you have before starting the training?
D0.6
DI can turn off the monitors and get 0.4 gb
F0.6 should work but still using some extra. i wonder if due to operating system
Fi tested vram usages on ubuntu
Dbut yesterday worked
Finteresting
Fare you using latest version?
Fof kohya
DI cant remenber what was diferent
Dit was rank 8
Dnow is working rank 8
D
Dfor Network Rank (Dimension) 8 I need to set Convolution Rank (Dimension) to 8 too?
Dand what about Network Alpha and Convolution Alpha?
Dyes I did a git pull before training
DI'm going to test your lowest_vram config now
DNow is working with your 1e_04_fp8_bf16_accelerate_full_bf16_32_rank config, I just restarted the PC and enabled buckets not all my images are 1024x1024 is working with great speed
Dthat was with my monitors turned off but I need to use my pc for other tasks, using the pc the speed decreased
�Is 200 epochs per image really necessary tho? 387 images in your dataset and training will be finished like in 4 days lol 
Dhehe yes
DI can stop it earlier and test
Dbut yes is too slow