So i just tried an a6000 with 48GB memory, using your 48GB_TextEncoder.json. Tried to set batch size
So i just tried an a6000 with 48GB memory, using your 48GB_TextEncoder.json. Tried to set batch size higher than 1, but I get an out of memory error on 4, 3, or 2, so I had to keep it at 1. Doesn't seem any faster than 4090 with batch size 1.
