Runpod•4mo ago

Too many open files on GPU pod A6000

On Pod A6000, frequently i'm facing "Too many open files" and "cannot allocate memory" whereas Comfyui is not using all VRAM/RAM.

Usually, it happens after sampler generation, during an interpolation process.

OS: Ubuntu 22.04 LTS
Soft: Comfyui with venv
Model: Wan 2.2
Volume: Network volume

Any clue is welcome.

wonzo255•9/10/25, 6:01 PM

what cuda verision are you using? also, can you paste the outputs of nvidia-smi -q

AAshtar On Pod A6000, frequently i'm facing "Too many open files" and "cannot allocate m...

PoddyAPP•9/12/25, 12:46 PM

@Ashtar

Escalated To Zendesk

The thread has been escalated to Zendesk!

Ticket ID: #23417

Jason•9/12/25, 12:46 PM

does this have to do with ulimits

JJason does this have to do with ulimits

AshtarOP•9/12/25, 8:26 PM

We can’t modify them , I tried to run ulimit command to override it and it is not allowed

Wwonzo255 what cuda verision are you using? also, can you paste the outputs of nvidia-smi ...

AshtarOP•9/12/25, 8:28 PM

Cuda 12.8 . I notice that nvidia-smi command is not working well, the table with process is always empty even when python (comfyui) is running a workflow and using the gpu / vram.

AAshtar Cuda 12.8 . I notice that nvidia-smi command is not working well, the table with...

wonzo255•9/13/25, 1:35 AM

can i see the -q output?

Jason•9/13/25, 1:45 AM

What for?