© 2026 Hedgehog Software, LLC

Twitter GitHub Discord

More

Communities Docs About Terms Privacy

Lora modules with basic vLLM serverless - Runpod

Runpod•2y ago•

2 replies

Lora modules with basic vLLM serverless

Is it possible to use lora modules with default vLLM endpoint ? If not, how is it possible to do it quickly ?

We're a community of enthusiasts, engineers, and enterprises, all sharing insights on AI, Machine Learning and GPUs!

21,202Members

Resources

Similar Threads

Was this page helpful?

Similar Threads

Serverless vllm - lora

RRunpod / ⚡｜serverless

LoRA path in vLLM serverless template

RRunpod / ⚡｜serverless

Can I use LoRA in vLLM serverless with OpenAI API?

RRunpod / ⚡｜serverless

Serverless VLLM batching

RRunpod / ⚡｜serverless