Trying to store thumbs on another device than main images, but can't get it to work

Hi, I'm trying to follow this (https://immich.app/docs/guides/custom-locations/) documentation page, to move thumbs and the other "fast needed" storage to a locally mounted block volume. I have my main images on a rclone mounted SFTP drive at /mnt/hetzner_storage_box/immich-library, and trying to move the thumbs to a locally mounted block volume /mnt/block_volume/immich. However immich keeps complaining that it can't find the thumbs folders. I'll put some useful info below: docker-compose.yml and .env: https://bpa.st/IC2Q Error log:
immich_server | [Nest] 17 - 06/02/2025, 1:16:17 PM ERROR [Api:GlobalExceptionFilter~c6zoalyr] Unknown error: Error: ENOENT: no such file or directory, access 'upload/thumbs/dbae834e-2cb3-4a05-9fe6-03cfdaf920b9/5b/d0/5bd08f04-aa8f-4349-8036-990298dfbef5-thumbnail.webp'
immich_server | Error: ENOENT: no such file or directory, access 'upload/thumbs/dbae834e-2cb3-4a05-9fe6-03cfdaf920b9/5b/d0/5bd08f04-aa8f-4349-8036-990298dfbef5-thumbnail.webp'
immich_server | at async access (node:internal/fs/promises:605:10)
immich_server | at async sendFile (/usr/src/app/dist/utils/file.js:53:9)
immich_server | at async AssetMediaController.viewAsset (/usr/src/app/dist/controllers/asset-media.controller.js:60:13)
immich_server | [Nest] 17 - 06/02/2025, 1:16:17 PM ERROR [Api:GlobalExceptionFilter~c6zoalyr] Unknown error: Error: ENOENT: no such file or directory, access 'upload/thumbs/dbae834e-2cb3-4a05-9fe6-03cfdaf920b9/5b/d0/5bd08f04-aa8f-4349-8036-990298dfbef5-thumbnail.webp'
immich_server | Error: ENOENT: no such file or directory, access 'upload/thumbs/dbae834e-2cb3-4a05-9fe6-03cfdaf920b9/5b/d0/5bd08f04-aa8f-4349-8036-990298dfbef5-thumbnail.webp'
immich_server | at async access (node:internal/fs/promises:605:10)
immich_server | at async sendFile (/usr/src/app/dist/utils/file.js:53:9)
immich_server | at async AssetMediaController.viewAsset (/usr/src/app/dist/controllers/asset-media.controller.js:60:13)
A command that shows there is definitely a file there:
$ ls -lha /mnt/block_volume/immich/thumbs/dbae834e-2cb3-4a05-9fe6-03cfdaf920b9/5b/d0/5bd08f04-aa8f-4349-8036-990298dfbef5-thumbnail.webp
-rw-rw-r-- 1 root root 16K May 24 16:40 /mnt/block_volume/immich/thumbs/dbae834e-2cb3-4a05-9fe6-03cfdaf920b9/5b/d0/5bd08f04-aa8f-4349-8036-990298dfbef5-thumbnail.webp
$ ls -lha /mnt/block_volume/immich/thumbs/dbae834e-2cb3-4a05-9fe6-03cfdaf920b9/5b/d0/5bd08f04-aa8f-4349-8036-990298dfbef5-thumbnail.webp
-rw-rw-r-- 1 root root 16K May 24 16:40 /mnt/block_volume/immich/thumbs/dbae834e-2cb3-4a05-9fe6-03cfdaf920b9/5b/d0/5bd08f04-aa8f-4349-8036-990298dfbef5-thumbnail.webp
Not sure what I'm doing wrong. Also I can't seem to bash into the container to do an ls from there.
13 Replies
Immich
Immich5mo ago
:wave: Hey @Puddingvlaai, Thanks for reaching out to us. Please carefully read this message and follow the recommended actions. This will help us be more effective in our support effort and leave more time for building Immich :immich:. References - Container Logs: docker compose logs docs - Container Status: docker ps -a docs - Reverse Proxy: https://immich.app/docs/administration/reverse-proxy - Code Formatting https://support.discord.com/hc/en-us/articles/210298617-Markdown-Text-101-Chat-Formatting-Bold-Italic-Underline#h_01GY0DAKGXDEHE263BCAYEGFJA Checklist I have... 1. :ballot_box_with_check: verified I'm on the latest release(note that mobile app releases may take some time). 2. :ballot_box_with_check: read applicable release notes. 3. :ballot_box_with_check: reviewed the FAQs for known issues. 4. :ballot_box_with_check: reviewed Github for known issues. 5. :ballot_box_with_check: tried accessing Immich via local ip (without a custom reverse proxy). 6. :ballot_box_with_check: uploaded the relevant information (see below). 7. :ballot_box_with_check: tried an incognito window, disabled extensions, cleared mobile app cache, logged out and back in, different browsers, etc. as applicable (an item can be marked as "complete" by reacting with the appropriate number) Information In order to be able to effectively help you, we need you to provide clear information to show what the problem is. The exact details needed vary per case, but here is a list of things to consider: - Your docker-compose.yml and .env files. - Logs from all the containers and their status (see above). - All the troubleshooting steps you've tried so far. - Any recent changes you've made to Immich or your system. - Details about your system (both software/OS and hardware). - Details about your storage (filesystems, type of disks, output of commands like fdisk -l and df -h). - The version of the Immich server, mobile app, and other relevant pieces. - Any other information that you think might be relevant. Please paste files and logs with proper code formatting, and especially avoid blurry screenshots. Without the right information we can't work out what the problem is. Help us help you ;) If this ticket can be closed you can use the /close command, and re-open it later if needed. Successfully submitted, a tag has been added to inform contributors. :white_check_mark:
Mraedis
Mraedis5mo ago
Did you move the folders after changing the mounts too? If not, you need to do that first.
Puddingvlaai
PuddingvlaaiOP5mo ago
Yup, I did!
Mraedis
Mraedis5mo ago
Sorry misread the error there
Puddingvlaai
PuddingvlaaiOP5mo ago
Copied to the new location, and moved the old location to thumbs.old etc
Mraedis
Mraedis5mo ago
Can you do the ls command from inside the container i.e. docker exec immich_server ls -la /usr/src/app/upload/thumbs/dbae834e-2cb3-4a05-9fe6-03cfdaf920b9/5b/d0/5bd08f04-aa8f-4349-8036-990298dfbef5-thumbnail.webp
Puddingvlaai
PuddingvlaaiOP5mo ago
docker exec immich_server ls -la /usr/src/app/upload/thumbs/dbae834e-2cb3-4a05-9fe6-03cfdaf920b9/5b/d0/5bd08f04-aa8f-4349-8036-990298dfbef5-thumbnail.webp
-rw-rw-r-- 1 root root 15702 May 24 16:40 /usr/src/app/upload/thumbs/dbae834e-2cb3-4a05-9fe6-03cfdaf920b9/5b/d0/5bd08f04-aa8f-4349-8036-990298dfbef5-thumbnail.webp
docker exec immich_server ls -la /usr/src/app/upload/thumbs/dbae834e-2cb3-4a05-9fe6-03cfdaf920b9/5b/d0/5bd08f04-aa8f-4349-8036-990298dfbef5-thumbnail.webp
-rw-rw-r-- 1 root root 15702 May 24 16:40 /usr/src/app/upload/thumbs/dbae834e-2cb3-4a05-9fe6-03cfdaf920b9/5b/d0/5bd08f04-aa8f-4349-8036-990298dfbef5-thumbnail.webp
without a problem! I've also noticed that this doesn't happen always. If it happens, a restart of the server (docker compose down, docker compose up -d) sometimes fixes the problem
Mraedis
Mraedis5mo ago
mmm Wondering whether it's simply a matter of the file not being reachable yet when it's needed You could run the "missing" thumbs job and see if your server complains about any other thumbs missing
Puddingvlaai
PuddingvlaaiOP5mo ago
I've also noticed that the thumbs, backups, encoded-video directories reappear in the old /mnt/hetzner_storage_box/immich-library/ directory on startup. Also not sure where those appear from
Mraedis
Mraedis5mo ago
it's a docker thing
Puddingvlaai
PuddingvlaaiOP5mo ago
Now on startup there is no problem at all, and running the missing thumbs job does nothing I'm confused and I can't figure it out
Mraedis
Mraedis5mo ago
Hurray I wouldn't worry about it unless thumbs start missing in your GUI
Puddingvlaai
PuddingvlaaiOP5mo ago
Yeah sometimes they do, which is weird. I did have a mistake in my backup script though at first (stopping and starting the containers did not correctly add the bind mounts and such), but I think I fixed that But maybe that is still a problem, I may need to check that again Ah it seems I have the exact same issue as discussed here: https://github.com/immich-app/immich/discussions/11944 which is super annoying Ugh

Did you find this page helpful?