Community cloud servers repeatedly fail to correctly download containers

A100 PCIe 80GB servers repeatedly fail to download parts of containers. Easiest template to reproduce this on is the Text Generation Web UI and APIs template. simply start it, and if you get a CUDA error, it's because that part of the container silently failed
Solution
Sounds like you didn't read the README and select the correct CUDA version.
Monosnap_Templates_2024-03-14_18-39-40.png
Was this page helpful?