ferdinandjason
RRunPod
•Created by ferdinandjason on 4/10/2025 in #⛅｜pods-clusters
Problem with hanging pod
no logs
40 replies
RRunPod
•Created by ferdinandjason on 4/10/2025 in #⛅｜pods-clusters
Problem with hanging pod
yes, I don't have any backup right now 😦
tried to start the pod again ~10 minutes ago, but it's not getting up until right now
40 replies
RRunPod
•Created by ferdinandjason on 4/10/2025 in #⛅｜pods-clusters
Problem with hanging pod
But surely you can report this to support ticket, have you created one?created in this https://contact.runpod.io/hc/en-us/requests/15833
40 replies
RRunPod
•Created by ferdinandjason on 4/10/2025 in #⛅｜pods-clusters
Problem with hanging pod
I'd suggest moving and trying in another podI still need the data / the training checkpoint, how do to that?
40 replies
RRunPod
•Created by ferdinandjason on 4/10/2025 in #⛅｜pods-clusters
Problem with hanging pod
40 replies
RRunPod
•Created by ferdinandjason on 4/10/2025 in #⛅｜pods-clusters
Problem with hanging pod
the VRAM is around 66% usages
40 replies
RRunPod
•Created by ferdinandjason on 4/10/2025 in #⛅｜pods-clusters
Problem with hanging pod
no error message related sadly
the training loop is somehow stuck, and not going any further,
and when running
nvidia-smi command it's still hangging around 7 hours40 replies
RRunPod
•Created by ferdinandjason on 4/10/2025 in #⛅｜pods-clusters
Problem with hanging pod
I'm training machine learning model right now, so some python scripts
40 replies
RRunPod
•Created by ferdinandjason on 4/10/2025 in #⛅｜pods-clusters
Problem with hanging pod
now stopped the pod
40 replies
RRunPod
•Created by ferdinandjason on 4/10/2025 in #⛅｜pods-clusters
Problem with hanging pod
and I'm still charged
40 replies
RRunPod
•Created by ferdinandjason on 4/10/2025 in #⛅｜pods-clusters
Problem with hanging pod
and now https://discord.com/channels/912829806415085598/1359897197201719327/1359898014323572817 it's happening again
40 replies
RRunPod
•Created by ferdinandjason on 4/10/2025 in #⛅｜pods-clusters
Problem with hanging pod
it's really disturbing right now
40 replies
RRunPod
•Created by ferdinandjason on 4/10/2025 in #⛅｜pods-clusters
Problem with hanging pod
can up now, but it's restarted / stopped multiple times
40 replies
RRunPod
•Created by ferdinandjason on 4/10/2025 in #⛅｜pods-clusters
Problem with hanging pod
40 replies
RRunPod
•Created by ferdinandjason on 4/10/2025 in #⛅｜pods-clusters
Problem with hanging pod
https://contact.runpod.io/hc/en-us/requests/15833
Raised in there also
40 replies