R
RunPod•5mo ago
Baboluo

How do I run custom code on a Runpod instance?

This sounds like you need to create a publicly accessible Docker image to run any code, is that true?
No description
3 Replies
ashleyk
ashleyk•5mo ago
The docker image doesn't need to be public, it can be private and then you add your registry credentials. @justin added a bunch of useful resources under the #📚｜resources section.
Baboluo
Baboluo•5mo ago
And passing a github repo doesnt work?
ashleyk
ashleyk•5mo ago
You can store your application in a Github repo but still need a docker image to run it. If your application is light weight and doesn't need a lot of OS dependencies and things, you can probably get away with using the RunPod PyTorch templates.
Want results from more Discord servers?
Add your server
More Posts
Running on local URL but can't access from outsideHi guys, I have this service running in my pod but I can't seem to access it through the intended waHow can I use ollama Docker image?Hello. I've been trying to serve ollama on RunPod using ollama Docker image (https://hub.docker.com/Comfyui won't run because of the missing NVidia driversyesterday my comfyui worked well, now when i try to launch it i get the error: RuntimeError: Found nRunPod Library + APISo I am attempting to create an API to either start/stop an existing pod or create a pod and then stCuda DriverI am getting the following error. I was setting up a new runpod, since the one I setup last night waSGLang worker (similar to worker-vllm)Recently, some progress has been made for efficiently deploying LLMs and LMMs. SGLang is up to 5x faVery low download speed. Will take days to download the model300 Kb/S IS NOT FAIR!!!I need to speak about my credits in my account. ThanksI need to speak with someone from management/support about my credits in my account. ThanksInsanely Fast WhisperI am trying to get this to work on Runpod to try and eek out some more speed over your faster-whispeHow do I start a pod with a private docker image (template) using GraphQL?I am trying to start pods with the graphql api, running my private image. In the docs it says this: