Runpod

We're a community of enthusiasts, engineers, and enterprises, all sharing insights on AI, Machine Learning and GPUs!

Join

Runpod

We're a community of enthusiasts, engineers, and enterprises, all sharing insights on AI, Machine Learning and GPUs!

Join

⚡｜serverless

⛅｜pods

🔧｜api-opensource

📡｜instant-clusters

🗂｜hub

codyman4488

3/4/2025

how to run a quantized model on server less? I'd like to run the 4/8 bit version of this model:

https://huggingface.co/unsloth/DeepSeek-R1-Distill-Qwen-32B-GGUF

rmnvc

3/4/2025

Troubles with answers

I use MistralAI 7B Instruct model and i use standart settings in serverless and im getting strange answers. I tried different temperament values, but it didn't help. Please tell me how to fix it...

Nikita

3/4/2025

Adding parameters to Docker when running Serverless

Hi. I need to add limit_mm_per_prompt to my Serverless Endpoint. How can i do it?

drycoco

3/4/2025

Serverless git integration rollback

Hi team! I've recently switched over to runpod serverless for production with the git integration. I have a concern about reliability in a failure scenario. Firstly, I notice that the builds take roughly 1.5 hours to build out and then for a worker to download + extract the image. Consider a bad release that starts getting rolled out - I can't see a button to stop it. Now, say it rolled out because I missed the process for whatever reason - I can't see a button to roll back to the previous good version....

andypotato

3/3/2025

Async workers not running

When using the /run endpoint I will receive the usual response: ``` { "id": "d0e6d88c-8274-4554-bb6a-0a469361ae20-e1", "status": "IN_QUEUE"...

Nellie

3/2/2025

Docker login to a specific registry

Hi, I'd like to login to nvcr.io using my API token. However, Runpod only allows me to set a username and password, but not let me specify a registry. How can I set this? I'm following the instructions here: https://build.nvidia.com/nvidia/audio2face-2d/docker...

Mado

3/1/2025

suggestion to create templates for repositories

Make it so that can use github repos instead of only docker images for templates

Milad

2/28/2025

Large delay time even with multiple available workers

We are having large delay time while workers sit idle. endpoint id: 9mzllv74e08hu4

AndiLeni

2/28/2025

CPU pod network volume

Will the issue with network volumes and cpu pods be fixed anytime soon? This missing feature is really slowing down my work 😦...

florian

2/28/2025

Unexpected Charges on serverless h100 80gb

Since a few hours we are being charged on serverless h100 even though there are no logs in our system nor have we been using the chip at all. Please advice!

amirh1541

2/28/2025

Creating serverless instance

Hi! I have very large docker image (50 GB). How should i create it so i will have the lowest coldstart time? Thanks!...

billchen

2/28/2025

fail: timeout ,exporting to oci image format. This takes a little bit of time. Please be patient.

#31 exporting to oci image format. This takes a little bit of time. Please be patient.

Yobin

2/28/2025

Getting executiontimeout exceeded

logs not showing anything too

DEOGEE

2/27/2025

Image build from github works fine but when i test with a request i get an error

ImportError: cannot import name 'TypeIs' from 'typing_extensions' (/usr/local/lib/python3.10/dist-packages/typing_extensions.py) I attached the error logs...

logs_1.txt

Kinder

2/27/2025

Updated workers to 10, now stuck in a loop

Hey, I upgraded the workers from 5 to 10, but now if I want to see how much money do I need for even more workers, I am stuck on this 10 -> 10 loop.

noahpantsparty

2/27/2025

Webhooks Stopped Working?

Anyone else noticing that their webhooks aren't being invoked after their workloads run? Noticing that i'm not getting any callbacks tonight.

Yobin

2/26/2025

30 minutes pending in serverless

wasnt liket this yesterday

Tobi

2/26/2025

Is there a maximum Runtime?

Hi, when I try running a job on my handler locally, everything works just fine, the job runs for about 12 minutes. However when I test my job with a serverless worker, after around 10 minutes, my job fails just in the middle of processing without throwing any error and the worker gets killed. Is there a maximum time a worker can run a Job? I could not find anything related to this in the docs.

inc3pt.io

2/26/2025

EUR-IS datacenter blacklisted by Elevenlabs?

I have a strange issue happening since yesterday, my serverless instance could not establish a wss communication with Elevenlabs API, it is throwing a 403 issue with the following link: https://help.elevenlabs.io/hc/en-us/articles/22497891312401-Do-you-restrict-access-to-the-service-and-platform-for-any-specific-countries Not sure if this is specific to Runpod or Elevenlabs but when I changed the datacenter to EUR-RO, the issue disappeared....

sahir

2/25/2025

queue delay times

Hi , I'm seeing really long delay times . even though there's nothing in the queue , and this is a really small CPU serverless endpoint . Any idea what causes this ?

Previous Next

Gaming

Programming

Runpod

We're a community of enthusiasts, engineers, and enterprises, all sharing insights on AI, Machine Learning and GPUs!

Runpod

We're a community of enthusiasts, engineers, and enterprises, all sharing insights on AI, Machine Learning and GPUs!