ReadTimeoutErrors in US-IL-1
Workers were running fine earlier today, but are now taking forever to start and half way through their execution (at no particular time or part of the code) they hang with the following:
'ReadTimeoutError("HTTPSConnectionPool(host='api.runpod.ai', port=443): Read timed out. (read timeout=8)")': /v2/6inskfdqe9z510/ping/ll0c30myrjn82o?gpu=NVIDIA+GeForce+RTX+4090&job_id=19f37b9a-f53e-4fea-b281-f7204b16df13-e2&runpod_version=1.7.13
For this particular run, the job ID is 19f37b9a-f53e-4fea-b281-f7204b16df13 and the worker ID is ll0c30myrjn82o (4090 in US-IL-1) in case someone can investigate.4 Replies
worker
a7d6dvh2yqpz05 with job id 7e70b4d6-49ac-4099-b2b2-47641f662be6-e1 was same for me.
can confirm. Also on 4090 in US-IL-1
I hadn't seen this thread, we're aware of an issue in US-IL-1 and have the datacenter investigating.
Thanks for the update!