How to build worker-vllm Docker Image without a model inside?
I would like to build a worker-vllm with slightly customized vLLM. However, I don't want to build it with a model inside. Basically, it should be the same as your Pre-Built Docker Image that would download the model to the Network Volume. Thanks!
https://github.com/runpod-workers/worker-vllm/
https://github.com/runpod-workers/worker-vllm/
GitHub
The RunPod worker template for serving our large language model endpoints. Powered by VLLM. - GitHub - runpod-workers/worker-vllm: The RunPod worker template for serving our large language model en...
