Runpod•8mo ago

how to pass hf_overrides to worker-vllm ?

https://docs.vllm.ai/en/latest/configuration/model_resolution.html

We're a community of enthusiasts, engineers, and enterprises, all sharing insights on AI, Machine Learning and GPUs!

21,080Members

View on Discord

Resources

Recent Announcements

Similar Threads

Was this page helpful?

Product

Pricing Docs Communities

Resources

About Blog Changelog Contributors

Legal

Terms Privacy Cookies EULA

Twitter GitHub Discord

© 2026 Hedgehog Software, LLC. All rights reserved.

© 2026 Hedgehog Software, LLC

Twitter GitHub Discord

More

Communities Docs About Terms Privacy

No replies yetBe the first to reply to this messageJoin

Similar Threads

RRunpod / ⚡｜serverless

SGLang worker (similar to worker-vllm)

RRunpod / ⚡｜serverless

VLLM WORKER ERRROR

RRunpod / ⚡｜serverless

update worker-vllm to vllm 0.5.0

RRunpod / ⚡｜serverless