Connect pods to GKE cluster
Our current inference operations are conducted on Google Kubernetes Engine (GKE). We are interested in leveraging RunPod's GPU offerings for inference tasks. Could you provide information on how to set up and utilize RunPod GPUs for inference purposes?
5 Replies
Unknown User•8mo ago
Message Not Public
Sign In & Join Server To View
@nerdylive Is there a way to auto-scale pods based on demand or do we need serverless for that?
Unknown User•8mo ago
Message Not Public
Sign In & Join Server To View
@nerdylive There are other essential services like DB, Message Queues etc running on my GKE cluster which needs to be connected to my service running on runpod, all these can be configured through ports?
Unknown User•8mo ago
Message Not Public
Sign In & Join Server To View