Adding parameters to Docker when running Serverless
Hi. I need to add limit_mm_per_prompt to my Serverless Endpoint. How can i do it?
5 Replies
Unknown User•8mo ago
Message Not Public
Sign In & Join Server To View
I try to run Qwen 2.5 VL 7B on VLLM on Serverless Endpoint
And I want to process more than one image per request
So this parameter is needed
Unknown User•8mo ago
Message Not Public
Sign In & Join Server To View
can I run my repo serverless after that?
Unknown User•8mo ago
Message Not Public
Sign In & Join Server To View