NappingSodion
IImmich
•Created by NappingSodion on 3/31/2025 in #help-desk-support
Unable to Utilize GPU (CUDA) for Machine Learning in Docker
Environment:
- OS: Windows 10 Pro
- Docker:
- Desktop Engine: 28.0.1 (with WSL2 Ubuntu 22.04 backend)
- Compose: v2.33.1-desktop.1
- GPU: NVIDIA GeForce RTX 2070
- Driver Version: 572.47
- CUDA Version: 12.8
Steps Taken:
1. Followed the official documentation to update
compose.yml and redeployed the container using:
2. Successfully tested GPU integration using the sample compose file from Docker's GPU support guide. The container correctly displayed GPU info (Driver Version, CUDA version, and GPU name).
- Note: Observed a minor discrepancy in NVIDIA-SMI version:
- Native Windows: 572.47
- Docker container: 570.86.17
3. Attempted to restart Immich with the updated compose configuration (details in the following conversation).
Issue:
The immich/immich_machine_learning container logs shows it still using CPU to process ML stuff and no CUDA usage shown in windows taskmgr(details in the following conversation).
Question:
I'm unsure how to proceed further. Any guidance on resolving this GPU utilization issue would be greatly appreciated.5 replies