vllm
Any plans to update the vllm image worker? I would like to test Phi 3 and Llama 3.1, currently both are unsupported with the current image. (serverless)
2 Replies
Gemma2 also doesn't seem to be supported
Unknown User•16mo ago
Message Not Public
Sign In & Join Server To View