© 2026 Hedgehog Software, LLC

Twitter GitHub Discord

More

Communities Docs About Terms Privacy

Serverless vllm - lora - Runpod

Runpod•2y ago•

11 replies

Serverless vllm - lora

Is there a way to set the lora-modules (for the vllm docker container --lora-modules lora_adapter1=abc/efg) in the Template, or do i need to use the "standard" vllm container for it?

We're a community of enthusiasts, engineers, and enterprises, all sharing insights on AI, Machine Learning and GPUs!

21,906Members

Resources

Recent Announcements

Sponsored

Similar Threads

Was this page helpful?

Similar Threads

LoRA path in vLLM serverless template

RRunpod / ⚡｜serverless

Lora modules with basic vLLM serverless

RRunpod / ⚡｜serverless

Can I use LoRA in vLLM serverless with OpenAI API?

RRunpod / ⚡｜serverless

Serverless VLLM batching

RRunpod / ⚡｜serverless