© 2026 Hedgehog Software, LLC

Twitter GitHub Discord

More

Communities Docs About Terms Privacy

vllm +openwebui - Runpod

Runpod•16mo ago•

43 replies

vllm +openwebui

Hi guys, has anyone used Vllm as endpoint in OpenWebUI? I have created a serverless pod but it does not let me connect from openwebui (loaded locally). Does anyone know if I have to configure the external port and how it would be?

We're a community of enthusiasts, engineers, and enterprises, all sharing insights on AI, Machine Learning and GPUs!

21,906Members

Resources

Recent Announcements

Sponsored

Similar Threads

Was this page helpful?

Similar Threads

qwen2.5 vllm openwebui

RRunpod / ⚡｜serverless

RRunpod / ⚡｜serverless

RRunpod / ⚡｜serverless

RRunpod / ⚡｜serverless