Topics

RunPod•4mo ago

Becoming a host MI250

Hello, Do you onboard hosts with AMD machines?

3 Replies

Justin Merrell•4mo ago

How many do you have available?

yamashi•4mo ago

we just ordered 24 x Mi250 in total

Justin Merrell•4mo ago

We may consider it, please sure you fit all the requirements here and fill out the form https://docs.runpod.io/hosting/overview

We're a community of enthusiasts, engineers, and enterprises, all sharing insights on AI, Machine Learning and GPUs!

11KMembers

View on Discord

Want results from more Discord servers?

Add your server

More Posts

GPU Pod was down all the nightHi, we just woke up to a production issue where our all apis were down because our pods just shut do H100 cluster group compilation errorI use RunPod Desktop on Secure H100 (both SXM5 and PCI3). CUDA Driver Version / Runtime Version Worker hangs for really long time, performance is not close to what it should beHi, I'm working with a transcription and diarization endpoint. The docker image works great, tested Stuck in creating containerNo matter how I had set up the pod, it would be stuck in starting container, dozens, 20, times. Then Custom template bash: /start.sh: No such file or directoryI.m triyng to run custon docer template nvidia/cuda:12.0.1-devel-ubuntu20.04 with container start co $0 balance in my accountHi, I had about $25 USD last night in my account. This morning I received a message to replenish my vllm + Ray issue: Stuck on "Started a local Ray instance."Trying to run `TheBloke/goliath-120b-AWQ` on vllm + runpod with `2x48GB` GPUs: ``` 2024-02-03T12:36:Why are my model files only 135 bytes after a clone repository on Pytorch template?Each safetensor file is only 135 bytes, despite me cloning the respository. All the other smaller fi