I'm not sure but I think you can. I'm able to train 512 on 8GB so 12GB should be just enough for 768

I'm not sure but I think you can. I'm able to train 512 on 8GB so 12GB should be just enough for 768 (gradient checkpoint ON). Also my experience is if I train (lora) in 768 I get good results on 768 images but worse results on 512 compared to a 512 training.
Was this page helpful?