How do I know or see progress on a remote ML instance?
I have Immich set up on Truenas for my main "server" version - which does not have any GPU. I have a windows 11 PC with WSL2 installed (ubuntu 24) and have a second copy of immich running, with the ROCM version for the machine learning library to utilize my AMD GPU 7900xtx.
I can connect from other systems on my network to my Win11 PC's IP and port 2283 and see the immich login page, and when I go to port 3003 (added to docker-compose) I get a web messsage "{"message":"Immich ML"}" So I presume the port forwarding and such between windows and WSL2 is working... But where do I see progress or actual GPU usage to know if this is working? Example: my win11 PC with the GPU is 192.168.1.6 and I've added the URL to my truenas immich instance in the machine learning settings of: http://192.168.1.6:3003 If this is all good and correct - how do I know if this is working and utilizing things properly?
I can connect from other systems on my network to my Win11 PC's IP and port 2283 and see the immich login page, and when I go to port 3003 (added to docker-compose) I get a web messsage "{"message":"Immich ML"}" So I presume the port forwarding and such between windows and WSL2 is working... But where do I see progress or actual GPU usage to know if this is working? Example: my win11 PC with the GPU is 192.168.1.6 and I've added the URL to my truenas immich instance in the machine learning settings of: http://192.168.1.6:3003 If this is all good and correct - how do I know if this is working and utilizing things properly?
12 Replies
:wave: Hey @Gleep52,
Thanks for reaching out to us. Please carefully read this message and follow the recommended actions. This will help us be more effective in our support effort and leave more time for building Immich :immich:.
References
- Container Logs:
docker compose logs docs
- Container Status: docker ps -a docs
- Reverse Proxy: https://immich.app/docs/administration/reverse-proxy
- Code Formatting https://support.discord.com/hc/en-us/articles/210298617-Markdown-Text-101-Chat-Formatting-Bold-Italic-Underline#h_01GY0DAKGXDEHE263BCAYEGFJA
Checklist
I have...
1. :ballot_box_with_check: verified I'm on the latest release(note that mobile app releases may take some time).
2. :ballot_box_with_check: read applicable release notes.
3. :ballot_box_with_check: reviewed the FAQs for known issues.
4. :ballot_box_with_check: reviewed Github for known issues.
5. :ballot_box_with_check: tried accessing Immich via local ip (without a custom reverse proxy).
6. :ballot_box_with_check: uploaded the relevant information (see below).
7. :ballot_box_with_check: tried an incognito window, disabled extensions, cleared mobile app cache, logged out and back in, different browsers, etc. as applicable
(an item can be marked as "complete" by reacting with the appropriate number)
Information
In order to be able to effectively help you, we need you to provide clear information to show what the problem is. The exact details needed vary per case, but here is a list of things to consider:
- Your docker-compose.yml and .env files.
- Logs from all the containers and their status (see above).
- All the troubleshooting steps you've tried so far.
- Any recent changes you've made to Immich or your system.
- Details about your system (both software/OS and hardware).
- Details about your storage (filesystems, type of disks, output of commands like fdisk -l and df -h).
- The version of the Immich server, mobile app, and other relevant pieces.
- Any other information that you think might be relevant.
Please paste files and logs with proper code formatting, and especially avoid blurry screenshots.
Without the right information we can't work out what the problem is. Help us help you ;)
If this ticket can be closed you can use the /close command, and re-open it later if needed.docker ps -a
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
f0be53d68126 ghcr.io/immich-app/immich-server:release "tini -- /bin/bash s…" 11 minutes ago Up 10 minutes (healthy) 0.0.0.0:2283->2283/tcp, [::]:2283->2283/tcp immich_server
756241819f13 tensorchord/pgvecto-rs:pg14-v0.2.0 "docker-entrypoint.s…" 11 minutes ago Up 10 minutes (healthy) 5432/tcp immich_postgres
a8f705a52852 valkey/valkey:8-bookworm "docker-entrypoint.s…" 11 minutes ago Up 10 minutes (healthy) 6379/tcp immich_redis
298a45d3058d ghcr.io/immich-app/immich-machine-learning:release-rocm "tini -- python -m i…" 11 minutes ago Up 10 minutes (healthy) 0.0.0.0:3003->3003/tcp, [::]:3003->3003/tcp immich_machine_learning
Successfully submitted, a tag has been added to inform contributors. :white_check_mark:
GPU usage: up to you
I don't think ROCm works on WSL though
also the logs would contain messages about images/things being parsed
easiest way to check if it works is to use that container as your only ML URL
When I have the remote machine learning Docker image running on my Win11 machine, I can observe 100% load on the RTX 5080 after uplpading new images to my Immich server.
Thanks buddy, that's not relevant at all here
Observing load might answer op's question
But ROCm does not work on WSL anyway
Because of drivers or some other reason?
I was following this guide - which says it works in WSL with the specific drives from AMD (which I've installed)
https://www.answeroverflow.com/m/1368859890331811920
Maching learning with gpu AMD on windows docker desktop . - Immich
Hy I have a amd 6800xt . and i would love to make the machine learning working with the gpu for the trancodage video on docker desktop (no linux for me ) . But i try really hard and nothing work .
Is anyone succes ?
That's strange because that "guide" is a discord topic, answered by me and I clearly state:
ROCm just does not work on WSL, and docker on windows only runs in WSL