Which host should I install Nvidia Container Toolkit on?
I'm running Proxmox which hosts a Debian 13 LXC which runs my Immich Docker container. I'm going to get hardware accelerated transcoding going.
Should I install the Nvidia Container Toolkit on Proxmox, or on the Debian LXC, or is this like the GPU driver where I need to install on both?
Immich is newly installed and working as of an hour ago. Just want to get HW accel going without screwing things up. 🙂
8 Replies
:wave: Hey @yaktone,
Thanks for reaching out to us. Please carefully read this message and follow the recommended actions. This will help us be more effective in our support effort and leave more time for building Immich :immich:.
References
- Container Logs:
docker compose logs docs
- Container Status: docker ps -a docs
- Reverse Proxy: https://immich.app/docs/administration/reverse-proxy
- Code Formatting https://support.discord.com/hc/en-us/articles/210298617-Markdown-Text-101-Chat-Formatting-Bold-Italic-Underline#h_01GY0DAKGXDEHE263BCAYEGFJA
Checklist
I have...
1. :ballot_box_with_check: verified I'm on the latest release(note that mobile app releases may take some time).
2. :ballot_box_with_check: read applicable release notes.
3. :ballot_box_with_check: reviewed the FAQs for known issues.
4. :ballot_box_with_check: reviewed Github for known issues.
5. :ballot_box_with_check: tried accessing Immich via local ip (without a custom reverse proxy).
6. :ballot_box_with_check: uploaded the relevant information (see below).
7. :ballot_box_with_check: tried an incognito window, disabled extensions, cleared mobile app cache, logged out and back in, different browsers, etc. as applicable
(an item can be marked as "complete" by reacting with the appropriate number)
Information
In order to be able to effectively help you, we need you to provide clear information to show what the problem is. The exact details needed vary per case, but here is a list of things to consider:
- Your docker-compose.yml and .env files.
- Logs from all the containers and their status (see above).
- All the troubleshooting steps you've tried so far.
- Any recent changes you've made to Immich or your system.
- Details about your system (both software/OS and hardware).
- Details about your storage (filesystems, type of disks, output of commands like fdisk -l and df -h).
- The version of the Immich server, mobile app, and other relevant pieces.
- Any other information that you think might be relevant.
Please paste files and logs with proper code formatting, and especially avoid blurry screenshots.
Without the right information we can't work out what the problem is. Help us help you ;)
If this ticket can be closed you can use the /close command, and re-open it later if needed.Just try the default docker things first and see what works?
Successfully submitted, a tag has been added to inform contributors. :white_check_mark:
If you mean, try it without HW accel, then I've done that. Just fired it up, and my photos are starting to backup now.
No, I mean just set it up for HWaccel
If it can't find your cards for whatever reason it just falls back to cpu
I think the answer is to install it on the LXC because it hosts the docker daemon
Not sure tho. I'll try and figure this out.
Short answer: Install NVIDIA Container Toolkit directly on the LXC
Longer answer:
Once your GPU is properly exposed to the LXC (here's the guide I used)
https://www.youtube.com/watch?v=Met9pEfxsF8
https://digitalspaceport.com/how-to-setup-an-ai-server-homelab-beginners-guides-ollama-and-openwebui-on-proxmox-lxc/
1) Install NVIDIA Container Toolkit onto the LXC. We're installing this on the LXC because it's the docker daemon host. Proxmox is the host machine, but that isn't relevant to this process.
https://docs.nvidia.com/datacenter/cloud-native/container-toolkit/latest/install-guide.html#
2) Follow Immich docs on changing your compose and add the
hwaccel.transcoding.yml file
https://immich.app/docs/features/hardware-transcoding
2b) I had a nvidia-container-cli: mount error: failed to add device rules error. Immich-server wouldn't start.
I applied both the Failed to initialize NVML: Unknown Error fix and the Rootless mode fix. One or both of those solved my error. It lives!
3) Follow Immich docs on changing your compose and add the hwaccel.ml.yml file
https://immich.app/docs/features/ml-hardware-acceleration
Everything works now.
It survives reboots. Yay! \o/
This thread has been closed. To re-open, use the button below.