OutOfMemory

why my tasks keeps on failing with

out of memory

out of memory

I'm just running large-v2 on faster-whisper on a 4090 GPU

Runpod Join

We're a community of enthusiasts, engineers, and enterprises, all sharing insights on AI, Machine Learning and GPUs!

21,202Members

Resources

Similar Threads

Was this page helpful?

Twitter GitHub Discord

Communities Docs About Terms Privacy

Star

Setup for Free

Twitter GitHub Discord

Communities Docs About Terms Privacy

OutOfMemory - Runpod

Runpod•2y ago•

33 replies

사탄

OutOfMemory

why my tasks keeps on failing with

out of memory

out of memory

I'm just running large-v2 on faster-whisper on a 4090 GPU

Runpod Join

We're a community of enthusiasts, engineers, and enterprises, all sharing insights on AI, Machine Learning and GPUs!

21,202Members

Resources

RRunpod / ⚡｜serverless

2y ago

Can we add minimum GPU configs required for running the popular models like Mistral, Mixtral?

RRunpod / ⚡｜serverless

2y ago

Serverless deepseek-ai/DeepSeek-R1 setup?

RRunpod / ⚡｜serverless

13mo ago

Trying to work with: llama3-70b-8192 and I get out of memory

RRunpod / ⚡｜serverless

15mo ago

Similar Threads

Was this page helpful?

RRunpod / ⚡｜serverless

2y ago

Can we add minimum GPU configs required for running the popular models like Mistral, Mixtral?

RRunpod / ⚡｜serverless

2y ago

Serverless deepseek-ai/DeepSeek-R1 setup?

RRunpod / ⚡｜serverless

13mo ago

Trying to work with: llama3-70b-8192 and I get out of memory

RRunpod / ⚡｜serverless

15mo ago