Runpod

R

Runpod

We're a community of enthusiasts, engineers, and enterprises, all sharing insights on AI, Machine Learning and GPUs!

Join

⚡｜serverless

⛅｜pods

🔧｜api-opensource

📡｜instant-clusters

🗂｜hub

Haashim
Haashim
View on Discord
8/16/2024

Volume / Storage issues

I am attempting to install comfy on a few different machines. Before Comfy and the flux dev models are done installing I am getting a out of volume error and cannot run the pod. Could this be just a bad string of luck in a few broken pods? Or am I not srtting something up correctly?...
No description
kostas
kostas
View on Discord
8/16/2024

I'm trying to start a cpu pod using the graphql endpoint and specifying an image

Hey, I've succesfully ran a cpu pod creation using the graphql endpoint, however, it does not seem to follow the same structure as the gpu creation. What I'm trying which is working is: ``` mutation { deployCpuPod( input: { ...
Jas
Jas
View on Discord
8/15/2024

Please help urgent

Hey I have been struggling for hours trying to set up this pod to train a LORA for Flux..... Can someone explain why or how the container is full? I know that I need to install some models, but shouldn't they go into the Volume - which I made to 200GB to avoid storage issues?!...
No description
tzk
tzk
View on Discord
8/15/2024

Running custom docker images (used in Serverless) to use in Pods

Hey everyone - so here is my current situation: - I have created a custom docker image for my serverless endpoint in Runpoint - My local machine is a macbook so I am unable to execute the NVIDIA dependent comfyui installation I have in the image, so trying to see if I can run this on a Runpoint pod instead - The use case is that I'm trying different workflows in ComfyUI that I want to test out in a Pod, before I deploy to the Serverless endpoint...
hi_lucky
hi_lucky
View on Discord
8/15/2024

cloud sync fail

Syncing to Dropbox failed; it always shows: Something went wrong! some detail:...
No description
mmo2112
mmo2112
View on Discord
8/15/2024

Can not start docker container

I use custom docker image: Here is system log: 2024-08-15T04:53:11Z start container Here is container log: 2024-08-15T04:52:55.667454224Z /usr/local/bin/docker-entrypoint.sh: line 414: exec: docker: not found SSH to this pod response Container not running....
Bitmap
Bitmap
View on Discord
8/15/2024

libcudnn.so.9: cannot open shared object file: No such file or directory

Getting this error when using the CUDAExecutionProvider with onnxruntime-gpu. I'm building the container for cuda 12 and installing onnxruntime-gpu 1.18 directly from microsoft's package index to fully support cuda 12. nvidia-smi works inside the container. not sure why im getting the issue.
youcef
youcef
View on Discord
8/15/2024

Can't access pod

it's been down over 16 hours, would be great if this can be dealt with ASAP. Stuck on Waiting for logs if I try to turn it on
No description
dynafire
dynafire
View on Discord
8/14/2024

Multiple containers on a single GPU instance?

Are there any plans to allow multiple docker containers on a single GPU instance? I have workloads which do not utilize the full resources of a single GPU, and I'd like to be organize the workloads using multiple containers sharing a single GPU. I don't believe there is a way to do this currently, the closest is to run multiple processes inside a single docker container, but that is a docker anti-pattern and not very good for workload organization.
Rfoxes
Rfoxes
View on Discord
8/14/2024

Connecting Current Pod to Network Volume

Hello, is there a way to connect a current pod to a network volume, or would I have to transfer all the data into a network volume and set up a new pod. If that is the case, what's the fastest way to do that (I have a large dataset I would have to move)?
leduyson2603
leduyson2603
View on Discord
8/14/2024

Weird error when deploy lorax inference server

Hi guys, i'm trying to deploy the lorax inference server on runpod A100 PCIe pod. I got a very weird error attached in the image. Why the error is weird? Because it only happened for some pods but not all, do you guys know any reason about this?
No description
liuxdong
liuxdong
View on Discord
8/14/2024

Waiting for logs Unable to initialize, it keeps initializing,Unable to initialize, it keeps initiali

Restarting the pod will clear all data
blankspace
blankspace
View on Discord
8/14/2024

Passwordless SSH doesn’t work half the time.

I’m using pods in the secure cloud. Half the time, I can’t SSH in and it asks for a password. My key is in authorized files, all the settings for the ssh server are right, but it won’t accept my key. Debug logging gives no reason why. The template is a standard PyTorch 2.2 template from RunPod. The only thing I can do is set a root password and allow using it for SSH and enter my password every time, which is very annoying. Happens all the time and then every now and then it doesn’t and I can SSH in fine without a password. Nothing different on my end. Same template, same scripts doing the login. ...
Mariano
Mariano
View on Discord
8/13/2024

Flux in Runpod Stable Diffusion WebUI Forge doesn't work in Runpod, although it seems to be possible

I've seen your tutorial to run Flux in Runpod in your blog, but it doesn't work for me, got many errors that I can't solve, I'm not a programmer, sorry 😦 I would like to install Flux in Forge. Why it doesn't work in the version is running in Runpod, is it going to be possible...
Thibaud
Thibaud
View on Discord
8/13/2024

vllm seems not use GPU

i'm using vllm and on the graph, when i launch some request, only cpu usage increase. if i open a terminal and launch nvidia-smi, i didn't see any process too. settings line...
No description
Chilistick
Chilistick
View on Discord
8/12/2024

Updated a1111 and now i cant connect to the webui port

used git checkout master and git pull in the terminal to update and now i cant connect the port. im getting a 502 | README | Runpod. I already tried deleting the venv and waiting 30 min; no luck. using the official runpod a1111 template
antoniocosta.eu
antoniocosta.eu
View on Discord
8/12/2024

Pod resume failed: This machine does not have the resources to deploy your pod.

Hello! I'm getting this error: Pod resume failed: This machine does not have the resources to deploy your pod. Please try a different machine My pod is a RTX 3090 , 10GB container disk and 60gb volume disk. How can I prevent this from happening?...
Flynn
Flynn
View on Discord
8/12/2024

Help! My Port 3000 (A1111 web-ui) isn't starting up.

i'm using the ashleykza/a1111 template. It's been working fine till today when I uploaded some new LoRAs.
utmostmick0
utmostmick0
View on Discord
8/12/2024

Can't update custom nodes ComfyUI

New install , update comfy , try to update comfy manager , nothing happens , What am I doing wrong ?
No description
lil_sean
lil_sean
View on Discord
8/12/2024

pod with custom template have no tcp ports exposed

Hi, I just created my custom template, and I set the ports to be exposed in the template, but after I deploy a pod, it has no ports exposed, did I configure something wrong?...
No description
PreviousNext