No Space Left on Device /var/lib/docker/tmp reported during Worker Initialization
I am seeing "no space left on device" failure when initializing a serverless worker, RTX 4090 / 41 GB RAM class in US-IL. Does this mean that the worker does not even have enough disk space to deploy my Docker image?
-- snip -- 69168d8a856c Extracting [==============================================> ] 1.83GB/1.96GB 69168d8a856c Extracting [===============================================> ] 1.846GB/1.96GB 4f4fb700ef54 Download complete failed to pull image: write /var/lib/docker/231072.231072/tmp/GetImageBlob2565438473: no space left on device worker is ready --------- It hits this error and just loops and attempts again. I have launched this same container on other workers without this issue. Is my only solution to terminate the worker and hope I get shifted to another physical worker with enough space?
-- snip -- 69168d8a856c Extracting [==============================================> ] 1.83GB/1.96GB 69168d8a856c Extracting [===============================================> ] 1.846GB/1.96GB 4f4fb700ef54 Download complete failed to pull image: write /var/lib/docker/231072.231072/tmp/GetImageBlob2565438473: no space left on device worker is ready --------- It hits this error and just loops and attempts again. I have launched this same container on other workers without this issue. Is my only solution to terminate the worker and hope I get shifted to another physical worker with enough space?
2 Replies