© 2026 Hedgehog Software, LLC

Twitter GitHub Discord

More

Communities Docs About Terms Privacy

Can I use LoRA in vLLM serverless with OpenAI API? - Runpod

Runpod•5mo ago•

20 replies

deseculavalutent

Can I use LoRA in vLLM serverless with OpenAI API?

I need both LoRA and Structured Outputs, but it seems like LoRA is only supported by Runpod API and Structured Outputs are only (poorly) supported by OpenAI API?

We're a community of enthusiasts, engineers, and enterprises, all sharing insights on AI, Machine Learning and GPUs!

21,906Members

Resources

Recent Announcements

Sponsored

Similar Threads

Was this page helpful?

Similar Threads

Serverless vllm - lora

RRunpod / ⚡｜serverless

Lora modules with basic vLLM serverless

RRunpod / ⚡｜serverless

LoRA path in vLLM serverless template

RRunpod / ⚡｜serverless

Custom vLLM OpenAI compatible API

RRunpod / ⚡｜serverless