GPU no longer available but continuing to get charged
As as 12:07AM PST Feb 7th - training has crashed due to CUDA not available error and looks like there is a warning message about "We have detected a critical error on this machine which may affect some pods. We are looking into the root cause and apologize for any inconvenience. We would recommend backing up your data and creating a new pod in the meantime.". So GPU is not available. Our training has crashed. But we are still getting charged hourly