RunpodR
Runpod7mo ago
zoob

runpod api questions about gpu type availability and gpu count

  • how can i get precise information about availability of some gpu type for pod creating on demand?
  • is stockStatus value from LowestPrice type of graphql api representing availability status of some specific gpu to create pod with?
my workflow is:
graphql gpuTypes query -> passing to POST https://rest.runpod.io/v1/pods request body gpu count from my local ui(not more than maxGpuCountCommunityCloud i parsed for specific gpu type) and gpu type id
but i am getting some issues with these maxGpuCountCommunityCloud values. since, for example, creating a pod with RTX 3070 passing gpuCount = 8 with maxGpuCountCommunityCloud = 8 (all on community cloud) i am getting internal server error response and message that it is unavailable to create pod this way. but it works with gpuCount = 3

also, on my local UI i need to render the list of gpu types that are only available and ready to pod creation on demand. can i use stockStatus for this? cuz i was able to create pod with some gpu that were market as unavailable on the official deploy page, so i am not sure it is what i look for

can you please help me with understanding how does availability(max gpu count too) info works in this api?
image.png
image.png
image.png
Was this page helpful?