Missing photos, webdav mount
I have run into issues with approximately 1% of my photos while scanning into Immich. Webdav mount in Docker host with read-only davfs from Nextcloud (so albums shared there are also included in Immich). Error messages in Docker logs, but unable to identify which photo (file path) it complains about. Is there something about my setup that creates this problem? Running v1.125.7.
36 Replies
:wave: Hey @Fair,
Thanks for reaching out to us. Please carefully read this message and follow the recommended actions. This will help us be more effective in our support effort and leave more time for building Immich :immich:.
References
- Container Logs:
docker compose logs docs
- Container Status: docker ps -a docs
- Reverse Proxy: https://immich.app/docs/administration/reverse-proxy
- Code Formatting https://support.discord.com/hc/en-us/articles/210298617-Markdown-Text-101-Chat-Formatting-Bold-Italic-Underline#h_01GY0DAKGXDEHE263BCAYEGFJA
Checklist
I have...
1. :ballot_box_with_check: verified I'm on the latest release(note that mobile app releases may take some time).
2. :ballot_box_with_check: read applicable release notes.
3. :ballot_box_with_check: reviewed the FAQs for known issues.
4. :ballot_box_with_check: reviewed Github for known issues.
5. :ballot_box_with_check: tried accessing Immich via local ip (without a custom reverse proxy).
6. :ballot_box_with_check: uploaded the relevant information (see below).
7. :ballot_box_with_check: tried an incognito window, disabled extensions, cleared mobile app cache, logged out and back in, different browsers, etc. as applicable
(an item can be marked as "complete" by reacting with the appropriate number)
Information
In order to be able to effectively help you, we need you to provide clear information to show what the problem is. The exact details needed vary per case, but here is a list of things to consider:
- Your docker-compose.yml and .env files.
- Logs from all the containers and their status (see above).
- All the troubleshooting steps you've tried so far.
- Any recent changes you've made to Immich or your system.
- Details about your system (both software/OS and hardware).
- Details about your storage (filesystems, type of disks, output of commands like fdisk -l and df -h).
- The version of the Immich server, mobile app, and other relevant pieces.
- Any other information that you think might be relevant.
Please paste files and logs with proper code formatting, and especially avoid blurry screenshots.
Without the right information we can't work out what the problem is. Help us help you ;)
If this ticket can be closed you can use the /close command, and re-open it later if needed.
Successfully submitted, a tag has been added to inform contributors. :white_check_mark:Try rerunning metadata extraction
Done multiple times. Also tried rescanning, and regenerating all thumbnails (but appears full image does not load either).
What is logged when you run metadata extract?
[Nest] 7 - 02/02/2025, 3:47:14 PM WARN [Microservices:MetadataService] Asset 8eb58e03-12cb-44e3-ab7e-3a8eefa1562b has no time zone information
[Nest] 7 - 02/02/2025, 3:47:14 PM WARN [Microservices:MetadataService] Asset 5d62da0f-42e0-4303-9c91-ee3a7632e2e4 has no time zone information
[Nest] 7 - 02/02/2025, 3:48:32 PM WARN [Microservices:MapRepository] Response from database for natural earth reverse geocoding latitude: xxx, longitude: xxx was null
No other errors or warnings..
Sorry for bumping the thread, but is this not a valid setup for Immich or is the problem elsewhere?
Hi, WEBDAV is a pretty strange setup and I have to imagine that is a factor here
what is your UPLOAD_LOCATION set to?
Webdav as external library is the only way I found to integrate with folders from Nextcloud, which is where I store my files.
UPLOAD_LOCATION=/mnt/data/library
This is a hard drive on the Docker host VM
how is it passed to the VM?
Mounted with davfs2 in the VM (see fstab screenshot), mount point passed as external library to Immich. 99% of photos and videos work, just a few within each folder fails. If there is a way to find which path/file corresponds to the failing photo IDs, that would be a helpful starting point to figure out where it fails..
the UPLOAD_LOCATION is using davfs ??
why
No, UPLOAD_LOCATION is a local disk on the VM. Only external libraries are mounted with davfs.
so my question was, how is the UPLOAD_LOCATION mount passed to the VM?
it's a physical disk that is formatted/mounted within the VM?
please share the following
docker-compose.yml
.env
/etc/fstab (minimal redaction please)
Storage of immich library
/dev/sdb1 /mnt/data ext4 auto 0 0
.env:
You can find documentation for all the supported env variables at https://immich.app/docs/install/environment-variables
The location where your uploaded files are stored
#UPLOAD_LOCATION=./library
UPLOAD_LOCATION=/mnt/data/library
The location where your database files are stored
DB_DATA_LOCATION=./postgres
To set a timezone, uncomment the next line and change Etc/UTC to a TZ identifier from this list: https://en.wikipedia.org/wiki/List_of_tz_database_time_zones#List
TZ=Etc/UTC
The Immich version to use. You can pin this to a specific version like "v1.71.0"
IMMICH_VERSION=release
Connection secret for postgres. You should change it to a random password
Please use only the characters
A-Za-z0-9, without special characters or spaces
DB_PASSWORD=
The values below this line do not need to be changed
###################################################################################
DB_USERNAME=postgres
DB_DATABASE_NAME=immich
sorry about the formatting, not sure how to post that betteryou can query the database for the uuid
SELECT * FROM "assets" WHERE id = '<uuidhere>';Oh, I can attach text files here..
Not a developer, so I have to ask - To query, is there a docker exec required first or do I need a database tool?
https://immich.app/docs/guides/database-queries/
yes, docker exec
I identified a failed file with the query, and am able to read it normally in the shell
you can try running tools like
exiftool, and convert to see if it's corrupt
my guess is there are momentary inconsistencies in webdav that immich is just not designed to handle
we plan for local storage or low latency network like NFS or samba. S3, dav, are not designed to be accessed in exactly the same way
you could run refresh thumbnail for that image and see what happensI can read the exif just fine, so what you are saying sounds plausible
I have refreshed the thumbnails multiple times, same photos fail over and over
strange, can you zip up one of the files and share here/
If necessary yes, but I am pretty sure it's not the file itself. Has not caused issues in other software for over 20 years
$ file DSCN9779.JPG
DSCN9779.JPG: JPEG image data, Exif standard: [TIFF image data, little-endian, direntries=11, description= , manufacturer=NIKON, model=E950, orientation=upper-left, xresolution=216, yresolution=224, resolutionunit=2, software=v981p-79, datetime=2003:10:18 11:33:36], baseline, precision 8, 1600x1200, components 3
I would prefer NFS myself, but that would require saving the same file redundantly in different folders for sharing with family members
I assume it's either dav or the file. If re-running it still fails I feel like it's not dav
ok, give a few minutes to locate a shareable file example
you could also just upload it to your own immich instance tbh
but if that doesn't work you'll probably still have to share it so we can see why
Aha, it uploads successfully and then fails to display
then, works perfectly after "refresh thumbnail"
well that's normal because the job isn't done yet when you first upload
unless you gave it a minute or 2
Ok. So the file works, I guess it's time to find an alternative to webdav
I suspect so, sorry
could be something with file watchers, some kind of overhead, etc
not monitoring folders, that seems a bit optimistic for this mount 😛
Thanks a lot for your help anyway. Always nice to at least figure out where the problem is
I'm sure you could write a small script to create the albums or something if you want
Any parameters or settings I can tune to make this work with higher latency, or is it too built into the structure of immich?
IDK how often they change
mostly built in.
Yes, will look into the community scripts for folders to albums perhaps
Ok, thanks. Loving everything else about Immich so hoping to find a solution 👍