Is the vLLM worker updated for LLaMA3.1 yet?

If not, is anyone aware of a good serverless container that does support it?

2 Replies

Unknown User•16mo ago

Message Not Public

tim•15mo ago

It is updated, you can use it!

We're a community of enthusiasts, engineers, and enterprises, all sharing insights on AI, Machine Learning and GPUs!

20KMembers