Automatically shut down pod after being idle for X mins

Ccyberzen Hi guys, a general question: I'd like to automatically shut down my pod after be...

E

Encyrption•9/17/24, 6:18 PM

Could you monitor the GPU usage and then shut down X minutes after GPU VRAM goes to 0, or similar?

EEncyrption Could you monitor the GPU usage and then shut down X minutes after GPU VRAM goes...

C

cyberzenOP•9/17/24, 6:23 PM

Yes that would be a nice solution. How could I achieve this?

Ccyberzen Yes that would be a nice solution. How could I achieve this? 🙂

E

Encyrption•9/17/24, 6:28 PM

I'm not sure if this is official or not but below is how I poll the GPU in JavaScript, using graphQL.

const myJSON = JSON.stringify({query: `
        query Pod {
                pod(input: {podId: "${POD_ID}"}) {
                        id
                        name
                        runtime {
                                uptimeInSeconds
                                ports {
                                        ip
                                        isIpPublic
                                        privatePort
                                        publicPort
                                        type
                                }
                                gpus {
                                        id
                                        gpuUtilPercent
                                        memoryUtilPercent
                                }
                                container {
                                        cpuPercent
                                        memoryPercent
                                }
                        }
                }
        }`
});

const myJSON = JSON.stringify({query: `
        query Pod {
                pod(input: {podId: "${POD_ID}"}) {
                        id
                        name
                        runtime {
                                uptimeInSeconds
                                ports {
                                        ip
                                        isIpPublic
                                        privatePort
                                        publicPort
                                        type
                                }
                                gpus {
                                        id
                                        gpuUtilPercent
                                        memoryUtilPercent
                                }
                                container {
                                        cpuPercent
                                        memoryPercent
                                }
                        }
                }
        }`
});

const myJSON = JSON.stringify({query: `
        query Pod {
                pod(input: {podId: "${POD_ID}"}) {
                        id
                        name
                        runtime {
                                uptimeInSeconds
                                ports {
                                        ip
                                        isIpPublic
                                        privatePort
                                        publicPort
                                        type
                                }
                                gpus {
                                        id
                                        gpuUtilPercent
                                        memoryUtilPercent
                                }
                                container {
                                        cpuPercent
                                        memoryPercent
                                }
                        }
                }
        }`
});

const myJSON = JSON.stringify({query: `
        query Pod {
                pod(input: {podId: "${POD_ID}"}) {
                        id
                        name
                        runtime {
                                uptimeInSeconds
                                ports {
                                        ip
                                        isIpPublic
                                        privatePort
                                        publicPort
                                        type
                                }
                                gpus {
                                        id
                                        gpuUtilPercent
                                        memoryUtilPercent
                                }
                                container {
                                        cpuPercent
                                        memoryPercent
                                }
                        }
                }
        }`
});

EEncyrption I'm not sure if this is official or not but below is how I poll the GPU in JavaS...

C

cyberzenOP•9/17/24, 6:32 PM

Thanks a lot!

Automatically shut down pod after being idle for X mins

Similar Threads

Similar Threads

Similar Threads