My PROD GPU Pod keeps on going off during traffic time. How to keep it awake 24/7 ?
Hi,
I'm running FastAPI with some models with GPU. But there will be 0 traffic some-times, POD is going off and port gets changed. so when API Request comes it was unable to serve it back since FastAPI Port is killed & I've to reinstall packages + start server.
How to keep the server up 24/7. Since POD runs on docker, I was not able to utilize systemctl to start/stop the App. any advice please ??
Thanks,

3 Replies
Unknown User•4w ago
Message Not Public
Sign In & Join Server To View
I've installed in network storage, File were exist but server was not up @Jason Can u share me any blog / doc page if you have to keep pod up for 24/7
Unknown User•4w ago
Message Not Public
Sign In & Join Server To View