R
RunPod•6mo ago
justin

How much RAM do we have per Serverless endpoint?

I am curious about how does RAM usage work? Since for fly.io you can allocate RAM / CPU, but here for runpod we only choose the GPU/whatever VRAM the GPU has. But if I am doing something like memory intensive like video / audio processing, will it just crash at some point bc of it?
Solution:
ram is least same as vram, most of the time its 25% higher than vram
Jump to solution
1 Reply
Solution
flash-singh
flash-singh•6mo ago
ram is least same as vram, most of the time its 25% higher than vram
Want results from more Discord servers?
Add your server
More Posts
Running LLaMA remotely from a Python scriptHi, new here, relatively new to LLMs as well. VERY new to remote computing. I've got a llama-cpp pyUrgent! So slow Download Speeds (Both Secure / Community Clouds)Hi, I am using sd web ui, and when I generate an image from UI or API, I can see that thestable diffHow to use runpod for multi-machine distributed training?We have applied symmetric ports for multiple machines and configured them to be accessible to each oCheck if a pod is idleHello, I am an admin for a team looking to start using runpod. I would like to be able to check whetthe bloke and llm not workingI am brand new to runpod. I just opened an account yesterday and put $25 on it. I used an 80g A100 aLarge discrepancy in broadband available and broadband usedI launched a pod which claims to have about 1688 Mbps download speed. However, when loading a model reproducible: pods crash 50% of the timei am trying to build an API which allows people without big GPUs to run googles weather forcasting mImport PIL (pillow image library) in rp_handler.pyHey everyone, i try to use a tool from the PIL module to process my generated image before sending b