R
RunPod7mo ago
justin

How much RAM do we have per Serverless endpoint?

I am curious about how does RAM usage work? Since for fly.io you can allocate RAM / CPU, but here for runpod we only choose the GPU/whatever VRAM the GPU has. But if I am doing something like memory intensive like video / audio processing, will it just crash at some point bc of it?
Solution:
ram is least same as vram, most of the time its 25% higher than vram
Jump to solution
1 Reply
Solution
flash-singh
flash-singh7mo ago
ram is least same as vram, most of the time its 25% higher than vram