© 2026 Hedgehog Software, LLC

Twitter GitHub Discord

More

Communities Docs About Terms Privacy

serverless deployment - Runpod

Runpod•2y ago•

5 replies

serverless deployment

i want to deploy my llm on serverless endpoint, how can i do that?

Solution

https://github.com/runpod-workers/worker-vllm

GitHub

GitHub - runpod-workers/worker-vllm: The RunPod worker template for...

The RunPod worker template for serving our large language model endpoints. Powered by vLLM. - runpod-workers/worker-vllm

Jump to solution

We're a community of enthusiasts, engineers, and enterprises, all sharing insights on AI, Machine Learning and GPUs!

21,202Members

Resources

Similar Threads

Was this page helpful?

Similar Threads

Custom serverless deployment

RRunpod / ⚡｜serverless

Serverless docker image deployment

RRunpod / ⚡｜serverless

Serverless Deployment runpod request Issue

RRunpod / ⚡｜serverless

Error getting response from a serverless deployment

RRunpod / ⚡｜serverless