Access to remote storage from vLLM
I want to make an API call with a file that is on a my RunPod remote storage.
But vLLM tell me:
I've tried to set a an ENV variable
I know I can try with a S3 remote storage or even a BASE64 but it's not as efficient as a mounted remote storage.
But vLLM tell me:
Cannot load local files without --allowed-local-media-pathI've tried to set a an ENV variable
`ALLOWED_LOCAL_MEDIA_PATH = trueI know I can try with a S3 remote storage or even a BASE64 but it's not as efficient as a mounted remote storage.
Solution
It works with that (if it can help others):
Add this line in:
So you can add an ENV variable with the paths you want (or by default it will be
"allowed_local_media_path": os.getenv('ALLOWED_LOCAL_MEDIA_PATH', '/runpod-volume')Add this line in:
/worker-vllm/src/engine_args.pySo you can add an ENV variable with the paths you want (or by default it will be
/runpod-volume
