Immich slow or is it my old NAS?
Hey guys, i see a lot of happy people using Immich, so I instaled it as a Docker container on my Synoogy DS3617xs with 48gb ram and 61,5Tb used of 96Tb space.
In my home folder on the NAS I have setup years folder and album folders within these folders. Also each year has a Video folder with some video's.
After 7 days the NAS is still busy with 80-80% CPU and the app still does not work smoothly.
I see thumb generate climbing every day (right no 1.4 million). Smart Search (146K), Face detect(468k), Face recognize(479k), Video Transcode (95k).
Is there something I can pause so the thumbnails will be generated? Of do I need to wait longer?
37 Replies
:wave: Hey @stefsegers,
Thanks for reaching out to us. Please carefully read this message and follow the recommended actions. This will help us be more effective in our support effort and leave more time for building Immich :immich:.
References
- Container Logs:
docker compose logs docs
- Container Status: docker ps -a docs
- Reverse Proxy: https://immich.app/docs/administration/reverse-proxy
- Code Formatting https://support.discord.com/hc/en-us/articles/210298617-Markdown-Text-101-Chat-Formatting-Bold-Italic-Underline#h_01GY0DAKGXDEHE263BCAYEGFJA
Checklist
I have...
1. :ballot_box_with_check: verified I'm on the latest release(note that mobile app releases may take some time).
2. :ballot_box_with_check: read applicable release notes.
3. :ballot_box_with_check: reviewed the FAQs for known issues.
4. :ballot_box_with_check: reviewed Github for known issues.
5. :ballot_box_with_check: tried accessing Immich via local ip (without a custom reverse proxy).
6. :ballot_box_with_check: uploaded the relevant information (see below).
7. :ballot_box_with_check: tried an incognito window, disabled extensions, cleared mobile app cache, logged out and back in, different browsers, etc. as applicable
(an item can be marked as "complete" by reacting with the appropriate number)
Information
In order to be able to effectively help you, we need you to provide clear information to show what the problem is. The exact details needed vary per case, but here is a list of things to consider:
- Your docker-compose.yml and .env files.
- Logs from all the containers and their status (see above).
- All the troubleshooting steps you've tried so far.
- Any recent changes you've made to Immich or your system.
- Details about your system (both software/OS and hardware).
- Details about your storage (filesystems, type of disks, output of commands like fdisk -l and df -h).
- The version of the Immich server, mobile app, and other relevant pieces.
- Any other information that you think might be relevant.
Please paste files and logs with proper code formatting, and especially avoid blurry screenshots.
Without the right information we can't work out what the problem is. Help us help you ;)
If this ticket can be closed you can use the /close command, and re-open it later if needed.Please share your compose and env
You probably have an infinite loop with the external and internal lib
62TB he might as well have 2 million assets
Uhhhh I didn’t assume that was all immich… I could be very wrong lol
The CPU, while old, should be OK for performance, but initial ingest can take days, even weeks if your library is this large
(But still post your compose and env so we see you don't have a loop)
Thanks all for the quick replies! I think 1.4 million. Might be what it is… and no it is not 62tb of images and videos, that is the total size of used data on the Nas.
How can I share. My compose and env?
Well it's text and you input it in your synology so... get that text and paste it here?
I removed my PW from the env file
Yeah, you can't set your UPLOAD Location and External Library as the same location. They need to be totally seperate. You are in a asset generation loop
You'll want to make a seperate folder for UPLOAD:
UPLOAD_LOCATION=/volume2/homes/stefan/Immich (or whatever)
and you can keep using /volume2/homes/stefan/Photos:/home:ro
@stefsegers better start fresh.
You cannot put any of UPLOAD_LOCATION, DB_DATA_LOCATION or any library inside of any of the othersgood to know!
But isn't my upload folder: - ${UPLOAD_LOCATION}:/usr/src/app/upload ??
BTW i am not planning to upload anything.. I only want to use Read Only from my Share on the NAS
The upload location is whatever you set in the env
It doesn’t matter if you aren’t planning to upload. You need a separate folder to store all the thumbnails etc
I changed the .env file: UPLOAD_LOCATION=/volume2/docker/immich-app/upload
I do need to docker compose again? Or restart the app in docker?
You should probably start over completely by resetting the database and delete all the immich folders that were created in the external library
oepsy.... I am a noob with this...
I do not see any folders created on my home folder that I used with Immich
so just stock with docker compose and restart docker compose agaun i suppose?
You probably still have to reset the database folder
okay.. used ChatGPT to do this... started a complete new immich/use/folder.... pitty... 7 days of energy lost 😦
hopefully everything will work correctly now 🙂
thanks all for the quick responses! 🫶🏼
The 1.8 milion images were gone in 1 hour, but after that it started climbing again and it keeps climbing. When I go to the images I get the Fault loading images.
Before I let it continue for a few days I would lik to be sure everything is setup correctly and working as it should be?
So share your new compose and env.
Did you remove the old immich folders?
yes I removed it... then I disabled immache, removed Database and started all over again
I do see the upload folder is being used 🙂
Mounts and paths look good @stefsegers
thanks for checking.. I will be waiting then 🙂
The thumbnails job will be about triple the images count as we generate 3 files per image
Good to k ow. Right now 1.4m thumbs and still climbing. Metadata 1.9m
How much assets are reported in the statistics page @stefsegers ? And I hope those aren't climbing? 😛
In server statics I can see 1900277 images and 13441 videos
Is that what you're expecting to have about? Or no idea? 🙂
I have no idea...
Well if you refresh the page, does it still go up?
the server statistics that is
sorry for late respone. I just checked: images: 1900277 video's 13441 after refresh. When I chack tasks, I can see it is still climbing 😦
I think there’s a current bug with external libraries where until an asset goes through metadata extraction, it gets queued whenever a library scan runs. It doesn’t affect typical size libraries much because metadata extraction generally finishes by the time the next scan starts. But for a huge library like this, it’s likely that a large fraction will still be in the metadata extraction queue and will get queued again on the next scan. This is fixed in the dev branch but hasn’t made it into a release yet.
I think you should disable the automatic scan for now in the admin settings until the jobs are done. As for the jobs, you can just let them sort themselves out. They won’t increase in number with the scan disabled
I will disable it and see what happens... I also get a lot ofmessages that the Docker app Immich is crashed and it restarts, and then continues.
Maybe it is me... but still climbing.. maybe this has something to do with the fact the app crashes multiple times a day? Might it. be an idea to show my log? (not sure how to get this log?)
Oh, the metadata extraction jobs will still queue thumbnail generation etc., but it won’t increase after that
yeah, i see the meta data is finished! Thumbnails are being done and this 3.2m images are being created i think? The Facedetection is increasing
Yes, that’s normal. The only thing is that it will do more work than necessary because some assets will be reprocessed
If you want to avoid that, it’s possible to cancel all the queues, run “missing” for thumbnail generation, wait for all the thumbnails to finish, then queue “missing” for smart search, face detection and transcoding
That way it’ll only queue the assets that actually need processing
so i clicked pause on thumb generation, and tried to click delete/clear... but nothing is working.. refresh page also not working
so restarted the app.. let's se what will happen