Upgrading VLLM to v0.6.0

I was wondering what the process would be to upgrade the serverless worker code to be compatible with the latest version of VLLM.

Runpod Join

We're a community of enthusiasts, engineers, and enterprises, all sharing insights on AI, Machine Learning and GPUs!

21,202Members

Resources

Recent Announcements

Similar Threads

Was this page helpful?

Twitter GitHub Discord

Communities Docs About Terms Privacy

Star

Setup for Free

Twitter GitHub Discord

Communities Docs About Terms Privacy

Upgrading VLLM to v0.6.0 - Runpod

Runpod•2y ago•

1 reply

gnarley_farley.

Upgrading VLLM to v0.6.0

I was wondering what the process would be to upgrade the serverless worker code to be compatible with the latest version of VLLM.

Runpod Join

We're a community of enthusiasts, engineers, and enterprises, all sharing insights on AI, Machine Learning and GPUs!

21,202Members

Resources

Recent Announcements

Similar Threads

update worker-vllm to vllm 0.5.0

RRunpod / ⚡｜serverless

2y ago

Chat completion (template) not working with VLLM 0.6.3 + Serverless

RRunpod / ⚡｜serverless

16mo ago

vllm

RRunpod / ⚡｜serverless

2y ago

vllm +openwebui

RRunpod / ⚡｜serverless

15mo ago

Similar Threads

Was this page helpful?

Similar Threads

update worker-vllm to vllm 0.5.0

RRunpod / ⚡｜serverless

2y ago

Chat completion (template) not working with VLLM 0.6.3 + Serverless

RRunpod / ⚡｜serverless

16mo ago

vllm

RRunpod / ⚡｜serverless

2y ago

vllm +openwebui

RRunpod / ⚡｜serverless

15mo ago