Cuda out of memory

Hello, I am using the Runpod PyTorch 2.1.
I am trying to train a small model (phi) about 1.5gb and whatever I do, I keep getting an error about Cuda out of memory from a process I don’t know where it comes from. I am using a 3090 gpu so I don’t understand where is the problem
Was this page helpful?