External Library created without Error, but Scan doesn't find any assets
I followed through on the documentation to create external Libraries.
Using the docker container console of immich-server and immich-microservices I see the folder and subfolder I would like to.
However no matter which scan I start, I don't recognize any progress whatsoever. 0 Assets are listed in the Libraries Overview...
I removed the exclusion pattern /RAF/. So nothing should get excluded...
Here is my docker-compose.yml, env cannot be posted discord says do long....
Server version 1.79.1
73 Replies
You can post them in pastebin and post the link here
And also the path settings in the wpp
https://pastebin.com/4UkQwpsa docker-compose
Pastebin
version: "3.9"services: immich-redis: image: redis container...
Pastebin.com is the number one paste tool since 2002. Pastebin is a website where you can store text online for a set period of time.
Pastebin
NODE_ENV=productionTZ=Europe/BerlinTYPESENSE_API_KEY=hHBc3ADffw6Ugn...
Pastebin.com is the number one paste tool since 2002. Pastebin is a website where you can store text online for a set period of time.
- "/volume1/LR RAW:/mnt/media/lrraw:ro"
try rename the folder to not have white space
so - /volume1/LR_RAW:/mnt/media/lrraw:rowithin the container calling /mnt/media/lrraw all pictures are listed
When you click on
scan library files, do you see anything in the server/microservices logs?i just removed the space and adopted the yml, I will try as soon as the containers are up again. Is there a seperate logfile or just the container log?
So the info pop up comes, that the library gets scanned, but nothing indicates, that it does:
btw:
So laso with space free Path the container sees the directory
I also tried the different modes for scanning, no difference
I just sett up the full App from scratch, but it also doesnt work then....
I have the same problem...
do you also have RAW photo files in your external library?
just trying to understand if this new feature does not work at all or just have issues with RAW formats
Yes, there are RAW files and JPEG files, but I can't find any of them.
Yes same here diffrent RAW formats loooooots of jpegs and videos...
@etnoy any thoughts? 🤔
Do you have the option to enable debug logging? There will be more info in the logs then
[Nest] 7 - 09/23/2023, 4:13:34 AM DEBUG [LibraryService] Found 0 assets when crawling import paths /mnt/media/lrraw
This is the only additional log message. This is from Microservice
Is there a level limit for the folder structure?
@helloworld Are your photos stored on a NAS or on the internal hard drive? I just found that mounting the internal hard drive is not an issue.
All the photos in my external library are stored on a NAS, connected locally using the AFP protocol. What's strange is that my upload library is also on the NAS, mounted in the same way, but there are no issues at all.
Strange
No spaces before or after the path?
@chixiang yes my photos are on a NAS. The same as the docker System is running on...
@etnoy no there are no spaces in the path values. And as I said, in the console of the docker container I see the files...
Glad I found this, I'm having the same issue. Import path is in the same folder structure as the External Path, click on add library, add the path I want, scan library. Get the notification at the top and then... nothing. No sign that immich is doing anything. Nothing in the micro services log either. The upload directory is in the same folder structure. So '/photos/User-photos'. Uploads are going into Year/Month folders below that as intended. Existing file structure for import in amongst that, so '/photos/User-photos/trip to mountains'. Previously I would use the cli-import but that appears to be broken - noticed that was being looked into. Also tried this with folders that don't have white space in them. Same issue.
can you post your docker-compose file? We will try to look for what you guys have in common to get this bug
Do you have special user permission set or anything like that?
Done, hope that helps!
your
USER1_LIBRARY_LOCATION is different from user1_LIBRARY_LOCATION in microservices containerSorry thats just where I obscured usernames. they are the same in reality
okay
I saw that the value has white space for the path
USER1_LIBRARY_LOCATION=E:\photos\User1 Photos
I assume you have actual white space?yep, it didn't seem to find it an issue with uploads and the cli import.
Just for the sake of consistency and avoid weirdness from Windows's path, can you try to not having the white space in those paths?
Yep can try, I'll have to do it when I get home from work. Also want to back up the DB before I do that.
Sounds good, let me know how it goes
I believe I've identified the issue. When I switched from the AFP protocol to the Samba protocol, the photos in the external library became recognizable. I switched back and forth a few times, and I can confirm that.
@helloworld What protocol did you use to map the NAS drive to the local?
@chixiang how do I find out? I run docker on the NAS (Synology) and just mapped the path, how do I see what protocol Docker user to mount the drive?
@helloworld Are you running Immich on the NAS? We might be different. I'm running Immich on my MacBook.
And then map the NAS drive to the macbook.
I am running immich on the NAS. itself.
So I did a backup. I actually just added a brand new user for one of my kids. Set up folder structure similar to ours but 'User3_Photos'. No whitespace. Maps to '/photos/User3-Photos' in docker container. Updated commpose and .env files to add it in. Restarted container and checked bind mounts, its there. Uploaded a few photos taken with an old phone, works fine. Copied a folder of photos over from my directory to this new directory, so under User3_Photos, changed whitespaces for underscores. It became 'Artemis_at_friends_house'. Added as external library. No joy. Just the notification that is scanning but no evidence its actually doing anything. Logs are quiet. Just typesense talking to itself. External library reads as 0b.
Did you add
/photo/user3-photos under external path in user panel in the administration page?yep
and also
/photo/user3-photos as import path in user3's user settings?In the external library?
In here
Ah! Yes. But the actual folder. /photos/User3-Photos/Artemis_at_friends_house
Can you set log level to debug and restart?
Can you try put
/photos/User3-Photos instead?Same result I'm afraid. Just restarting with logging set to debug and I'll try again.
2023-09-25 20:08:13 [Nest] 7 - 09/25/2023, 7:08:13 PM DEBUG [LibraryService] Found 0 assets when crawling import paths photos/User3-Photos
2023-09-25 20:08:13 [Nest] 7 - 09/25/2023, 7:08:13 PM DEBUG [LibraryService] 0 assets in library are not present on disk and will be marked offline
Got it working for user3! Forgot the / in front of photos. Worked instantly.
And got it working for user2. Its quite happy with whitespace in the folder names. Not sure what made that one start working...
awesome! Yes, you need a / before the path to make it absolute
Any chance my issue gets solved as well. Maybe some additional logging I should deploy?
Do you mind posting the actual path without obscuring the information? We might be able to spot something there
My post is not obscured. So the only difference is the logging level in the env, which meanwhile is on debugging
This is my last information
If you use the library path as /mnt/media does it work?
I.e having the external and library path similar
Have you tried using:
-/volume1/lrraw:/mnt/media/lrraw:ro
?
Keeping the last directories on both at the end the same. Don't forget to rename the actual folder though.
[Nest] 7 - 09/29/2023, 7:51:05 AM DEBUG [LibraryService] 0 assets in library are not present on disk and will be marked offline
[Nest] 7 - 09/29/2023, 7:51:05 AM DEBUG [LibraryService] Found 0 assets when crawling import paths /mnt/media/
[Nest] 7 - 09/29/2023, 8:00:52 AM DEBUG [LibraryService] 0 assets in library are not present on disk and will be marked offline
[Nest] 7 - 09/29/2023, 8:00:52 AM DEBUG [LibraryService] Found 0 assets when crawling import paths /mnt/media/lrraw
can you create a shell on your microservices container and check the contents of /mnt/media in there?
I did so several times. Via the console of the container I can the files, checked Microservices and immich server container.
Just as an example
And you see the same in the server container of course. Any exclusion patterns?
Yes, both Container consoles show exactly the same. At the moment I have no Exclusion patterns. I deleted the complete stack once already and cleared all folders except the upload folders. Immich also doesn't find any of the previously uploaded pictures, only the new ones in the same location. But nothing at all from the external path
Does it work if you make one of the file extensions lowercase?
Can you show "ls -l"? Maybe it is a permission issue.
This is very strange. Looking at the code it should be case insensitive for the extensions. Also I see you have some that are lowercase anyways. There is definitely a bug if the path doesn't end with a slash.
The only other thing I could think of is a permission issue maybe the user running the operations can't see the files. Can you post group and user permissions for some files?
yes, I agree it's strange and I have no idea why this would happen. Since you can see the files in the container, immich should at least be able to see them when crawling (since it runs as root)
Except he is not running it as root. It looks like the compose is configured with different permissions.
line 67
In that case, likely permissions
I run it also on a Synology. I use the user id for some containers but not for Immich.
He would need to remove it all: "user: 1027:100"
Or make sure the user with id 1027 or group with 100 has read rights on the correct folders.
Oh man, sorry, now it seems to be working... one question: if I add Exclusion patterns now, will they get filtered out, since the library job already started?
I'd say clear the job queue, set pattern and then rescan