Shouldn't larger VRAM bring more speed? The A800 (using Rank 1) has more than 3 times the VRAM of th
Shouldn't larger VRAM bring more speed? The A800 (using Rank 1) has more than 3 times the VRAM of the 4090D, but the speed is barely increased. Why is this? Is it because I haven't adjusted the batch_size?
