Immich•5mo ago

Trying to get immich remote machine learning working.

I've set up immich in my synology nas and remote machine learning windows via docker desktop app. however the nas is not sending anything. really no idea how to get it fix. Anyone can help?

22 Replies

Immich•5mo ago

:wave: Hey @Dididididi, Thanks for reaching out to us. Please carefully read this message and follow the recommended actions. This will help us be more effective in our support effort and leave more time for building Immich :immich:. References - Container Logs: docker compose logs docs - Container Status: docker ps -a docs - Reverse Proxy: https://immich.app/docs/administration/reverse-proxy - Code Formatting https://support.discord.com/hc/en-us/articles/210298617-Markdown-Text-101-Chat-Formatting-Bold-Italic-Underline#h_01GY0DAKGXDEHE263BCAYEGFJA Checklist I have... 1. :ballot_box_with_check: verified I'm on the latest release(note that mobile app releases may take some time). 2. :ballot_box_with_check: read applicable release notes. 3. :ballot_box_with_check: reviewed the FAQs for known issues. 4. :ballot_box_with_check: reviewed Github for known issues. 5. :ballot_box_with_check: tried accessing Immich via local ip (without a custom reverse proxy). 6. :ballot_box_with_check: uploaded the relevant information (see below). 7. :ballot_box_with_check: tried an incognito window, disabled extensions, cleared mobile app cache, logged out and back in, different browsers, etc. as applicable (an item can be marked as "complete" by reacting with the appropriate number) Information In order to be able to effectively help you, we need you to provide clear information to show what the problem is. The exact details needed vary per case, but here is a list of things to consider: - Your docker-compose.yml and .env files. - Logs from all the containers and their status (see above). - All the troubleshooting steps you've tried so far. - Any recent changes you've made to Immich or your system. - Details about your system (both software/OS and hardware). - Details about your storage (filesystems, type of disks, output of commands like fdisk -l and df -h). - The version of the Immich server, mobile app, and other relevant pieces. - Any other information that you think might be relevant. Please paste files and logs with proper code formatting, and especially avoid blurry screenshots. Without the right information we can't work out what the problem is. Help us help you ;) If this ticket can be closed you can use the /close command, and re-open it later if needed.

DididididiOP•5mo ago

name: immich_remote_ml

services:
  immich-machine-learning:
    container_name: immich_machine_learning
    # For hardware acceleration, add one of -[armnn, cuda, openvino] to the image tag.
    # Example tag: ${IMMICH_VERSION:-release}-cuda
    image: ghcr.io/immich-app/immich-machine-learning:${IMMICH_VERSION:-release}-cuda
    extends:
      file: hwaccel.ml.yml
      service: cuda # set to one of [armnn, cuda, openvino, openvino-wsl] for accelerated inference - use the `-wsl` version for WSL2 where applicable
    volumes:
      - model-cache:/cache
    restart: always
    ports:
      - 3003:3003

volumes:
  model-cache:

name: immich_remote_ml

services:
  immich-machine-learning:
    container_name: immich_machine_learning
    # For hardware acceleration, add one of -[armnn, cuda, openvino] to the image tag.
    # Example tag: ${IMMICH_VERSION:-release}-cuda
    image: ghcr.io/immich-app/immich-machine-learning:${IMMICH_VERSION:-release}-cuda
    extends:
      file: hwaccel.ml.yml
      service: cuda # set to one of [armnn, cuda, openvino, openvino-wsl] for accelerated inference - use the `-wsl` version for WSL2 where applicable
    volumes:
      - model-cache:/cache
    restart: always
    ports:
      - 3003:3003

volumes:
  model-cache:

windows desktop docker app

DididididiOP•5mo ago

appreciate your help @sogan, let me know if u need anything more

sogan•5mo ago

It looks like it’s being used based on the logs?

DididididiOP•5mo ago

dont think so

sogan•5mo ago

It’s clearly getting requests since it’s loading models

DididididiOP•5mo ago

this was so long ago

DididididiOP•5mo ago

is it? im not sure or should i turn on more detail logs to see it better

sogan•5mo ago

Unless you queried the remote ML server yourself, the only way you’d get those logs is if it got requests to process images

DididididiOP•5mo ago

I cant tell seems like server is not requesting to process anything

sogan•5mo ago

You can check nvidia-smi or better yet nvtop to confirm GPU utilization

DididididiOP•5mo ago

my server is running stuff

sogan•5mo ago

The remote ML server doesn’t output logs for individual requests fyi

DididididiOP•5mo ago

where do I input this nvtop

sogan•5mo ago

For windows it might be easier to use nvidia-smi or a gui-based tool like hwinfo64 Also, if those ML logs are the last logs from the container, it means the remote container has been getting a steady stream of requests. It would have unloaded the models if they weren’t used within a 5 minute period

DididididiOP•5mo ago

ah i still cant confirm or do I need all normal container to get it working?

DididididiOP•5mo ago

I only have 1 atm

DididididiOP•5mo ago

perhaps it is working, i can see the gpu jumping around with network traffic

sogan•5mo ago

Check the performance tab

Gaming

Programming

Trying to get immich remote machine learning working.

Did you find this page helpful?