R
RunPod•4mo ago
letajmal

Should i wait for the worker to pull my image

I have a large image (100 GB), should i wait for worker to pull the image before starting any inference
5 Replies
ashleyk
ashleyk•4mo ago
Yes
letajmal
letajmal•4mo ago
I've set a maximum of 3 workers. Can I initiate the job once any worker finishes downloading the image? I've noticed some image pull attempts failing and restarting. Should I terminate those workers, or will they recover automatically?
letajmal
letajmal•4mo ago
No description
letajmal
letajmal•4mo ago
should i wait for all 3 workers to download the image?
ashleyk
ashleyk•4mo ago
As long as one is ready
Want results from more Discord servers?
Add your server
More Posts
Possible memory leak on ServerlessWe're testing different mistral models (cognitivecomputations/dolphin-2.6-mistral-7b and TheBloke/doare we able to run DinD image for GPU pods?Hi, anyone tried running DinD in GPU pods?Runpod error starting container2024-03-07T14:40:19Z error starting container: Error response from daemon: failed to create task forRunpod SD ComfyUI Template missing??Where did the "Runpod SD ComfyUI" template go? Can anyone help? I've been using it extensively for aDockerless dev and deploy, async handler need to use async ?handler.py in HelloWorld project, there is not 'async' before def handler(job): . But in serverlesSomething broken at 1am UTCSomething was broken at 1am UTC which caused a HUGE spike in my cold start and delay times.Should I use Data Centers or Network Volume when confige serverless endpoint ?My project is an AI portrait app targeting global users. The advantage of using data centers is the Pod OutageCurrently taking 100x longer to pull the docker image and when it eventually builds I have an API seAre stream endpoints not working?This is a temp endpoint just to show you all. /stream isn't available, what's up?Cuda - Out of Memory error when the 2nd GPU not utilizedI have a pod with 2 x 80 GB PCIe and I am trying to load and run Smaug-72B-v0.1 LLM. The problem is,