Similar speed of workers on different GPUs
Hi, I am trying to launch the codeformer model on a serverless GPU. However, during testing I've noticed that it doesn't matter which GPU I choose, the speed would stay the same. So a100 works with the almost identical speed as with a4500. How could I fix that issue?
Solution
Main benefit of A100 is VRAM not performance, if you want performance, select 24GB PRO which is 4090.
