How much RAM do we have per Serverless endpoint?
I am curious about how does RAM usage work? Since for fly.io you can allocate RAM / CPU, but here for runpod we only choose the GPU/whatever VRAM the GPU has.
But if I am doing something like memory intensive like video / audio processing, will it just crash at some point bc of it?
But if I am doing something like memory intensive like video / audio processing, will it just crash at some point bc of it?
