RunPod

R

RunPod

We're a community of enthusiasts, engineers, and enterprises, all sharing insights on AI, Machine Learning and GPUs!

Join

⚡|serverless

⛅|pods

🔧|api-opensource

📡|instant-clusters

🗂|hub

Billing Info

on the GET https://rest.runpod.io/v1/billing/pods?grouping=gpuTypeId there is a property time in response. but as i receive it, for every billing record time value always shows 00:00:00 - it shows only date, in fact was this designed this way? can i somehow get the time too?(in addition to date)...
No description

runpod api questions about gpu type availability and gpu count

- how can i get precise information about availability of some gpu type for pod creating on demand? - is stockStatus value from LowestPrice type of graphql api representing availability status of some specific gpu to create pod with? my workflow is: graphql gpuTypes query -> passing to POST https://rest.runpod.io/v1/pods request body gpu count from my local ui(not more than maxGpuCountCommunityCloud i parsed for specific gpu type) and gpu type id...
No description

Retrieve public templates via REST API

Is there a way to fetch the public templates (the ones listed on https://www.runpod.io/console/explore)? The /templates endpoint only returns the templates I’ve created.

Access pod logs via API

Can someone please explain how to access the pod logs via the API? Seems only the web console has access, and the only thing preventing this from being added to runpodctlis being able to access hapi.runpod.net/v1/pod/<pod-id>/logs resource. See: https://github.com/runpod/runpodctl/issues/29...

curl: (7) Failed to connect to 64.247.206.102 port 8000 after 41 ms: Couldn't connect to server

My application is listening on port 8000 on the pod with the above-mentioned public ip address, but when i curl that from a server outside the runpod using this command: curl -X POST http://64.247.206.102:8000 -H "Content-Type: application/json" -d '{"prompt": "Test prompt" , "max_tokens": 50}' ...

OpenAI GPT Image 1 API error

Both moderation values - 'auto', 'low' - generate the same error
No description

Endpoint 20mb limitation

https://docs.runpod.io/serverless/endpoints/operations - what caused such limitations for the "/run" and "/runsync" endpoints of 10mb and 20mb, respectively? Are there any solutions on how to increase them?

Unable to access Custom Container & Community Templates

Hi team, I have credits on my RunPod account and have already deployed a pod, but I cannot find the “Custom Container” option nor any community templates in my UI. I’ve tried different browsers, cleared cache, and checked all menus (Templates, Explore, Pods), but the options simply don’t appear. Could you please check my account settings and unlock these features? Thank you!...

500 When trying to spawn pods too fast, is there a way to spawn multiple?

Ive managed to start 100 nodes with no issues using synchronus requests, but when I use async it gives me 500s quite often. I usually try to start 20-100 nodes at once but even 2 can cause the 500. ``` Error starting node nkKkw: Server error '500 Internal Server Error' for url 'https://rest.runpod.io/v1/pods' For more information check: https://developer.mozilla.org/en-US/docs/Web/HTTP/Status/500...

runpodctl expects a .rundpod.yaml file, not the modern runpod.toml file

I installed the latest runpodctl (on an arch-linux based system), and went to configure an API-key so I could upload a file to the pod. I got an unexpected error
Error: error saving config: Config File ".runpod.yaml" Not Found in "[/home/user/.runpod /home/user]
Error: error saving config: Config File ".runpod.yaml" Not Found in "[/home/user/.runpod /home/user]
However, $HOME/.runpod/ has a config.toml file, which I think the Runpod systems may have partially migrated to...?...

runpodctl install fails

sunil@bumbershoot2:~$ wget -qO- cli.runpod.net | sudo bash Installing runpodctl... All system requirements satisfied. Latest version of runpodctl: v1.14.4 runpodctl: Permission denied...

Runpodctl in need of some Runpod love @ Github

This is just a ping to the Runpod folks that it's been a quarter since any of you touched the runpodctl github repo with a commit. There are a number of PRs waiting for your attention. Would be great if someone could take a look....