Is there any serverless template, or vLLM compatible HF repo for Vision models?
Hi!
Are there any plug and play LLAVA serverless templates, or LLAMA 3 (or other) vision models that work with Runpod vLLM?
I was using Ashleyk's awesome runpod-worker-llava, but it has been removed since.
Are there any plug and play LLAVA serverless templates, or LLAMA 3 (or other) vision models that work with Runpod vLLM?
I was using Ashleyk's awesome runpod-worker-llava, but it has been removed since.
