R
RunPodletajmal

Should i wait for the worker to pull my image

I have a large image (100 GB), should i wait for worker to pull the image before starting any inference
A
ashleyk43d ago
Yes
L
letajmal43d ago
I've set a maximum of 3 workers. Can I initiate the job once any worker finishes downloading the image? I've noticed some image pull attempts failing and restarting. Should I terminate those workers, or will they recover automatically?
L
letajmal43d ago
No description
L
letajmal43d ago
should i wait for all 3 workers to download the image?
A
ashleyk43d ago
As long as one is ready
Want results from more Discord servers?
Add your server
More Posts
Possible memory leak on ServerlessWe're testing different mistral models (cognitivecomputations/dolphin-2.6-mistral-7b and TheBloke/doare we able to run DinD image for GPU pods?Hi, anyone tried running DinD in GPU pods?Runpod error starting container2024-03-07T14:40:19Z error starting container: Error response from daemon: failed to create task forRunpod SD ComfyUI Template missing??Where did the "Runpod SD ComfyUI" template go? Can anyone help? I've been using it extensively for aDockerless dev and deploy, async handler need to use async ?handler.py in HelloWorld project, there is not 'async' before def handler(job): . But in serverlesSomething broken at 1am UTCSomething was broken at 1am UTC which caused a HUGE spike in my cold start and delay times.Should I use Data Centers or Network Volume when confige serverless endpoint ?My project is an AI portrait app targeting global users. The advantage of using data centers is the Pod OutageCurrently taking 100x longer to pull the docker image and when it eventually builds I have an API seAre stream endpoints not working?This is a temp endpoint just to show you all. /stream isn't available, what's up?Cuda - Out of Memory error when the 2nd GPU not utilizedI have a pod with 2 x 80 GB PCIe and I am trying to load and run Smaug-72B-v0.1 LLM. The problem is,Postman returns either 401 Unauthorized, or when the request can be sent it returns as Failed, errorPostman reads the following, when I send runsync request from runpod tutorial (from generativelabs) Backdrop Build V3 Credits missingHi team, I hope this message finds you well. I am writing to follow up on the recent offer I receivText-generation-inference on serverless endpointsHi, I don't have much experience neither with llms nor with python, so I always just use this image When on 4000 ADA, it's RANDOMLY NOT DETECTING GPU!When on 4000 ADA, it's RANDOMLY NOT DETECTING GPU! Yesterday I set it up and it's okay. Today I set