Search
Setup for Free
R
Runpod
•
14mo ago
D
Question about serverless vllm endpoint
I would like to deploy Qwen2VL
-2B using vllm serverless
. I know that It will create an endpoint that I can use to send a prompt
. But I wonder if I could also send an image with prompt
?
Runpod
Join
We're a community of enthusiasts, engineers, and enterprises, all sharing insights on AI, Machine Learning and GPUs!
20,855
Members
View on Discord
Similar Threads
Was this page helpful?
Yes
No
© 2026 Hedgehog Software, LLC
Twitter
GitHub
Discord
System
Light
Dark
More
Communities
Docs
About
Terms
Privacy
No replies yet
Be the first to reply to this message
Join
Similar Threads
Urgent: Issue with Runpod vllm Serverless Endpoint
R
Runpod / ⚡|serverless
16mo ago
question about the data structure of a serverless endpoint
R
Runpod / ⚡|serverless
2y ago
Serverless VLLM batching
R
Runpod / ⚡|serverless
7mo ago
Serverless vllm - lora
R
Runpod / ⚡|serverless
15mo ago