R
Runpod•2d ago
PatrickCmd102

ReadOnly Filesystem

Hi Runpod, Are network storage volumes only in READ ONLY mode when mounted on serverless endpoints when running. I get this error when the cached model on the network storage is trying to get updated with changes from huggingface. See attached log

error_log.txt

2 Replies
PatrickCmd102
PatrickCmd102OP•2d ago
Or is it with how the new model store works 
Model Store is a caching system that places models on host machines before workers start. When you specify a model from Hugging Face, our scheduler prioritizes hosts that already have your model cached locally.

If cached: Workers start instantly, no download wait.

If not cached: The system downloads before your worker starts billing.
Model Store is a caching system that places models on host machines before workers start. When you specify a model from Hugging Face, our scheduler prioritizes hosts that already have your model cached locally.

If cached: Workers start instantly, no download wait.

If not cached: The system downloads before your worker starts billing.
Dj
Dj•11h ago
Interesting, I think the model isn't cached yet and vllm was trying to update the model as it recognized it wasn't fully complete

Did you find this page helpful?