Runpod•2y ago

Can I use torch2.3.0 + cuda 11.8 on Runpod?

I want upgrade my touch version to 2.3.0, can it works on Runpod ?

Jason•6/5/24, 8:48 AM

Hmm not sure, try it out. Why not use the current available template version of torch?

digigoblin•6/5/24, 8:58 AM

Torch 2.3.0 works with CUDA 11.8 but I suggest using CUDA 12.1 instead

JJason Hmm not sure, try it out. Why not use the current available template version of ...

fireiceOP•6/5/24, 8:58 AM

Because xformers 0.0.26 (RECOMMENDED, linux & win) Install latest stable with pip: Requires PyTorch 2.3.0. I am testing now.

fireiceOP•6/5/24, 9:07 AM

Traceback (most recent call last):
2024-06-05T09:04:11.388043478Z File "/runpod-volume/55fd91b5/prod/instantid/src/handler.py", line 14, in <module>
2024-06-05T09:04:11.388417474Z import diffusers
2024-06-05T09:04:11.388430521Z ModuleNotFoundError: No module named 'diffusers'.
I confirm that diffusers 0.27.0 is already installed. Why does this issue always occur in serverless?

digigoblin•6/5/24, 9:11 AM

It doesn't always occur, its specific to your installation. Maybe you installed it into a venv on a network volume or something.

Jason•6/5/24, 9:12 AM

I see

Ffireice Traceback (most recent call last): 2024-06-05T09:04:11.388043478Z File "/runpo...

Jason•6/5/24, 9:13 AM

Check it with pip, and check if you get venv on when launching your app

fireiceOP•6/5/24, 9:17 AM

ok , I will check.

Ddigigoblin It doesn't always occur, its specific to your installation. Maybe you installed...

fireiceOP•6/5/24, 9:30 AM

Dependencies are listed in the requirements.txt file，When running runpodctl project dev, don't these dependencies get automatically downloaded and installed?