I
Immich4mo ago
Vat.Kris

immich_machine_learning container keeps going to Warning status

Running Immich via docker on a Synology DS220+ and I enabled machine learning using openvino. Built successfully and able to access assets and app, all working fine. But running into two issues 1. I’m unable to say whether the GPU is being used as needed since it keeps falling back to CPU 2. Container machine learning randomly goes into “warning” and then goes back to “healthy” and unable to diagnose why
53 Replies
Immich
Immich4mo ago
:wave: Hey @Vat.Kris, Thanks for reaching out to us. Please carefully read this message and follow the recommended actions. This will help us be more effective in our support effort and leave more time for building Immich :immich:. References - Container Logs: docker compose logs docs - Container Status: docker ps -a docs - Reverse Proxy: https://immich.app/docs/administration/reverse-proxy - Code Formatting https://support.discord.com/hc/en-us/articles/210298617-Markdown-Text-101-Chat-Formatting-Bold-Italic-Underline#h_01GY0DAKGXDEHE263BCAYEGFJA
Immich
Immich4mo ago
Checklist I have... 1. :ballot_box_with_check: verified I'm on the latest release(note that mobile app releases may take some time). 2. :ballot_box_with_check: read applicable release notes. 3. :ballot_box_with_check: reviewed the FAQs for known issues. 4. :ballot_box_with_check: reviewed Github for known issues. 5. :ballot_box_with_check: tried accessing Immich via local ip (without a custom reverse proxy). 6. :ballot_box_with_check: uploaded the relevant information (see below). 7. :ballot_box_with_check: tried an incognito window, disabled extensions, cleared mobile app cache, logged out and back in, different browsers, etc. as applicable (an item can be marked as "complete" by reacting with the appropriate number) Information In order to be able to effectively help you, we need you to provide clear information to show what the problem is. The exact details needed vary per case, but here is a list of things to consider: - Your docker-compose.yml and .env files. - Logs from all the containers and their status (see above). - All the troubleshooting steps you've tried so far. - Any recent changes you've made to Immich or your system. - Details about your system (both software/OS and hardware). - Details about your storage (filesystems, type of disks, output of commands like fdisk -l and df -h). - The version of the Immich server, mobile app, and other relevant pieces. - Any other information that you think might be relevant. Please paste files and logs with proper code formatting, and especially avoid blurry screenshots. Without the right information we can't work out what the problem is. Help us help you ;) If this ticket can be closed you can use the /close command, and re-open it later if needed.
GitHub
immich-app immich · Discussions
Explore the GitHub Discussions forum for immich-app immich. Discuss code, ask questions & collaborate with the developer community.
GitHub
Issues · immich-app/immich
High performance self-hosted photo and video management solution. - Issues · immich-app/immich
Tempest
Tempest4mo ago
you need to start a ssh session with the nas, then run the logs command posted by the bot
Vat.Kris
Vat.KrisOP4mo ago
bo0tzz
bo0tzz4mo ago
What's the output of free -h?
Vat.Kris
Vat.KrisOP4mo ago
CONTAINER ID IMAGE COM MAND CREATED STATUS PORTS NAMES
1a8c1ab620d6 ghcr.io/immich-app/immich-server:release "ti ni -- /bin/bash s…" About an hour ago Up About an hour (healthy) 0.0.0.0:2 283->2283/tcp, :::2283->2283/tcp immich_server
4fde0ba386b0 ghcr.io/immich-app/immich-machine-learning:release-openvino "ti ni -- ./start.sh" About an hour ago Up About an hour (healthy) immich_machine_learning
c38eb130dbf1 tensorchord/pgvecto-rs:pg14-v0.2.0 "do cker-entrypoint.s…" 5 days ago Up About an hour (healthy) 5432/tcp immich_postgres
9e79bcca291b redis:6.2-alpine "do cker-entrypoint.s…" 5 days ago Up About an hour (healthy) 6379/tcp immich_redis
CONTAINER ID IMAGE COM MAND CREATED STATUS PORTS NAMES
1a8c1ab620d6 ghcr.io/immich-app/immich-server:release "ti ni -- /bin/bash s…" About an hour ago Up About an hour (healthy) 0.0.0.0:2 283->2283/tcp, :::2283->2283/tcp immich_server
4fde0ba386b0 ghcr.io/immich-app/immich-machine-learning:release-openvino "ti ni -- ./start.sh" About an hour ago Up About an hour (healthy) immich_machine_learning
c38eb130dbf1 tensorchord/pgvecto-rs:pg14-v0.2.0 "do cker-entrypoint.s…" 5 days ago Up About an hour (healthy) 5432/tcp immich_postgres
9e79bcca291b redis:6.2-alpine "do cker-entrypoint.s…" 5 days ago Up About an hour (healthy) 6379/tcp immich_redis
God damn it. Why does the same discord app behave so differently on windows vs ios.
Zeus
Zeus4mo ago
Do you have any resource limits applied?
Tempest
Tempest4mo ago
use backticks (` is beside the number 1)
Zeus
Zeus4mo ago
Also what’s the system specs
Vat.Kris
Vat.KrisOP4mo ago
None that I set up myself. All my compose and env files are stock except to add an external library and modify machine learning settings Synology DS220+ with 18GB of RAM Sorry, not sure what this is. Can you point me to some documentation?
Tempest
Tempest4mo ago
a ssh command. I don't think you've opened the terminal yet though based on the logs
Vat.Kris
Vat.KrisOP4mo ago
total used free shared buff/cache available
Mem: 17Gi 3.2Gi 2.8Gi 1.0Gi 11Gi 12Gi
Swap: 12Gi 1.3Gi 11Gi
total used free shared buff/cache available
Mem: 17Gi 3.2Gi 2.8Gi 1.0Gi 11Gi 12Gi
Swap: 12Gi 1.3Gi 11Gi
Tempest
Tempest4mo ago
can you share the output of
docker logs immich_machine_learning
docker logs immich_machine_learning
Vat.Kris
Vat.KrisOP4mo ago
Not using docker cli, I'm on SSH through Putty but my cli knowledge is severely limited
Tempest
Tempest4mo ago
might have to run sudo su first
Vat.Kris
Vat.KrisOP4mo ago
Yep, done that. It's generating the log into a file that is proviing troublesome. The output is garbled with special characters for some reason and I'm trying to figure it out.
Tempest
Tempest4mo ago
could also try
docker logs --tail 250 immich_machine_learning
docker logs --tail 250 immich_machine_learning
if the first is too large
Vat.Kris
Vat.KrisOP4mo ago
Finally!
Vat.Kris
Vat.KrisOP4mo ago
Putty keeps inserting session info into the log at various points that screwed up the formatting and it came up as special characters. Meh, you live and you learn.
Tempest
Tempest4mo ago
what's your job concurrency?
No description
Vat.Kris
Vat.KrisOP4mo ago
default
Tempest
Tempest4mo ago
set smart search and facial rec to 1
Vat.Kris
Vat.KrisOP4mo ago
Oh, I did change the
Minimum recognized faces
Minimum recognized faces
to 50
Tempest
Tempest4mo ago
that's fine, that's elsewhere
Vat.Kris
Vat.KrisOP4mo ago
Done
Tempest
Tempest4mo ago
then run a clean and build
No description
Vat.Kris
Vat.KrisOP4mo ago
Done
Tempest
Tempest4mo ago
now run
docker logs immich_machine_learning
docker logs immich_machine_learning
Vat.Kris
Vat.KrisOP4mo ago
This looks similar to yours. Does that mean it's working as intended?
Tempest
Tempest4mo ago
it hasn't processed anything
Vat.Kris
Vat.KrisOP4mo ago
Oh
Tempest
Tempest4mo ago
now go to jobs and make sure they're running
Vat.Kris
Vat.KrisOP4mo ago
Should I upload some assets and see how it's being processed?
Tempest
Tempest4mo ago
you can also hit the misssing button
No description
Tempest
Tempest4mo ago
since this is an initial upload I'd think you should still have stuff to go
Vat.Kris
Vat.KrisOP4mo ago
Smart Search job is running. Should I get the new log file after it's done processing?
Tempest
Tempest4mo ago
what's the output of
docker logs immich_machine_learning
docker logs immich_machine_learning
yea
Vat.Kris
Vat.KrisOP4mo ago
Tempest
Tempest4mo ago
looks to be working as intended
Vat.Kris
Vat.KrisOP4mo ago
Whoo!!
Tempest
Tempest4mo ago
buffalo_l is just facial detection if you run a smart search job then a different model should load
Vat.Kris
Vat.KrisOP4mo ago
Yeah I see ViT-B-32__openai under visual model
Tempest
Tempest4mo ago
if you want immich to be much better at smart search you can replace that model with
ViT-L-16-SigLIP-384__webli
ViT-L-16-SigLIP-384__webli
you will need to re-index all smart searches however but that's about the best one that'll work with the memory constraints of that model
Vat.Kris
Vat.KrisOP4mo ago
Yeah better now with limited assets rather than do it later with all my assets backed up right? Since I'm only just getting started with my initial load.
Tempest
Tempest4mo ago
I migrated a few times, but that's where I ended up. so if you want to start with the better model, you could change it before you upload more you can probably bump the concurrent smart-search and facial rec to 2, however beyond that isn't benetifical. And that's assuming that youre not doing video transcoding at the same time
Vat.Kris
Vat.KrisOP4mo ago
I don't want to migrate too many times. I've got 1.5TiB and I don't feel like doing this over and over again
Tempest
Tempest4mo ago
transcode videos I'd set to 1, and the rest I'd set to max 3 - depending on how many are all running at the same time. It's not a powerful cpu so it'll take its time I fully understand. Hence I'm giving as many hints as I can based on similar hardware
Vat.Kris
Vat.KrisOP4mo ago
That's fine, I'm not in a hurry, I just didn't want the CPU overloaded all the time! Truly appreciated Does this make a difference? https://github.com/1-tempest/immich-better-face-detection
Tempest
Tempest4mo ago
yeah. It detects more faces. Feel free to read the linked discord discussion. I'd personally just pause all jobs, run the command, and then resume as if nothing ever happened
Vat.Kris
Vat.KrisOP4mo ago
I did. Beyond my ken. Where should I run the command?
Tempest
Tempest4mo ago
just via ssh
Vat.Kris
Vat.KrisOP4mo ago
Thank you I'll close this now so that it's marked as such But seriously, this was super helpful. Thanks for the patience as well!
Immich
Immich4mo ago
This thread has been closed. To re-open, use the button below.

Did you find this page helpful?