R
RunPod•3mo ago
Jacoby1218

Community cloud servers repeatedly fail to correctly download containers

A100 PCIe 80GB servers repeatedly fail to download parts of containers. Easiest template to reproduce this on is the Text Generation Web UI and APIs template. simply start it, and if you get a CUDA error, it's because that part of the container silently failed
Solution:
Sounds like you didn't read the README and select the correct CUDA version.
No description
Jump to solution
3 Replies
Madiator2011
Madiator2011•3mo ago
mind giving more info what template what pod id what cuda version
Solution
ashleyk
ashleyk•3mo ago
Sounds like you didn't read the README and select the correct CUDA version.
No description
Jacoby1218
Jacoby1218•3mo ago
i honestly didn't even know that was something that could happen. then i guess this is resolved
Want results from more Discord servers?
Add your server
More Posts
Urgent: All new gpu pods are brokenHi, our existing pods and new pods we are creating are having all same issue where they cannot find CPU Pods NOT WORKINGI'm having issues with my template that worked for months and also with your template: `runpod/base:Streaming is not quite workingHi I was trying to deploy a simple huggingface model where my inference code looks like thisKnowing Which Machine The Endpoint UsedHi, I configured my endpoint to opt for multiple types of gpu like the image attached. When I run a how to know about serverless api region informationI want to get region where the serverless api deployed in the rp_handler.py for upload file to choosGPU usage when pod initialized. Not able to clear.Tried nvidia-smi -r, restarting, and reseting. There is still usage on one gpu in the pod.Chat History, Memory and MessagesI have a general usage question for runpod; when I open the web UI, under Parameters > Chat history Increase number of GPU-s in the existing pod?Hey folks, I have an existing pod with 2 A100 GPUs. I want to add two more to it. Is it possible? I How do i restart worker automatically or using some script?I have used this GitHub repository at https://github.com/runpod-workers/worker-template to implemet Keeping reverse proxy hostname between destroy/startHello, I'm using network storage for my pod. My use case doesn't require the container to be up 24/