streamlit app not loading up on CPU node
This is my dockerfile
```
FROM runpod/pytorch:2.2.0-py3.10-cuda12.1.1-devel-ubuntu22.04
WORKDIR /workspace...
Why FileBrowser cant be opened?
Why does a "HTTP Error 404" appear when I click on HTTP Service [Port 4040]? Even though the log output says "No module named 'ip_adapter'",.I want to check if the 'ip_adapter' file has been copied from the Docker Hub image to the 'runpod-volume/my project' directory. I do have this file in my local project.
[ONNXRuntimeError] when running ComfyUI
I'm a total noob when it comes these. I was able to run a vid2vid workflow for about a week now, no issues, but from yesterday, I'm running into this issue and I have no clue what to do. Anyone be able to help?
Cuda - Out of Memory error when the 2nd GPU not utilized
I have a pod with 2 x 80 GB PCIe and I am trying to load and run Smaug-72B-v0.1 LLM.
The problem is, I can download it and when I try to load it it gives me CUDA Out of memory exception while the 2nd GPU memory is empty. I was expecting that when I choose 2 x GPU to run I can use the sum capacity. If you check screenshot, the 2nd GPU memory not used at all when exception is fired. Also, there is no GPU instances with that big RAM so I have to choose 2x or 3x. How i can fix it? Thanks
The exception is:
torch.cuda.OutOfMemoryError: CUDA out of memory. Tried to allocate 384.00 MiB. GPU 0 has a total capacty of 79.11 GiB of which 168.50 MiB is free. Process 3311833 has 78.93 GiB memory in use. Of the allocated memory 78.31 GiB is allocated by PyTorch, and 189.60 MiB is reserved by PyTorch but unallocated. If reserved but unallocated memory is large try setting max_split_size_mb to avoid fragmentation. See documentation for Memory Management and PYTORCH_CUDA_ALLOC_CONF...