© 2026 Hedgehog Software, LLC

Twitter GitHub Discord

More

Communities Docs About Terms Privacy

Question about serverless vllm endpoint - Runpod

Runpod•16mo ago

Question about serverless vllm endpoint

I would like to deploy Qwen2VL-2B using vllm serverless. I know that It will create an endpoint that I can use to send a prompt. But I wonder if I could also send an image with prompt?

We're a community of enthusiasts, engineers, and enterprises, all sharing insights on AI, Machine Learning and GPUs!

21,202Members

Resources

Similar Threads

Was this page helpful?

Similar Threads

Urgent: Issue with Runpod vllm Serverless Endpoint

RRunpod / ⚡｜serverless

question about the data structure of a serverless endpoint

RRunpod / ⚡｜serverless

Serverless VLLM batching

RRunpod / ⚡｜serverless

Serverless vllm - lora

RRunpod / ⚡｜serverless