Migrating from external library to default - missing files
Hello,
I am nearly complete on my task of migrating from external to default library. I run 'immich import' on CLI to re-import all assets from external to default. In order to check nothing is missing I run a script to hash each file in my external library and compared to what is in /data/library/admin. I have 225 files which appear in external which aren't in default once I removed all my .yml, .tmp and unsupported formats etc.
For the ones that remain I have manually checked a few by running immich upload <file name> -j, typically I see it's failed to import due to duplicate asset, I then take the asset_id of the duplicate to view in Immich however they all seem to be corrupt / missing as Immich shows metadata but I get an error message where the Image is supppose to display which shows 'Error loading image'. The file path in Immich is also showing in the /data/upload directory rather than /data/library.... I have no files in /data/upload....Any idea why this would happen?
5 Replies
:wave: Hey @Jack Brown,
Thanks for reaching out to us. Please carefully read this message and follow the recommended actions. This will help us be more effective in our support effort and leave more time for building Immich :immich:.
References
- Container Logs:
docker compose logs docs
- Container Status: docker ps -a docs
- Reverse Proxy: https://immich.app/docs/administration/reverse-proxy
- Code Formatting https://support.discord.com/hc/en-us/articles/210298617-Markdown-Text-101-Chat-Formatting-Bold-Italic-Underline#h_01GY0DAKGXDEHE263BCAYEGFJA
Checklist
I have...
1. :ballot_box_with_check: verified I'm on the latest release(note that mobile app releases may take some time).
2. :ballot_box_with_check: read applicable release notes.
3. :ballot_box_with_check: reviewed the FAQs for known issues.
4. :ballot_box_with_check: reviewed Github for known issues.
5. :ballot_box_with_check: tried accessing Immich via local ip (without a custom reverse proxy).
6. :ballot_box_with_check: uploaded the relevant information (see below).
7. :ballot_box_with_check: tried an incognito window, disabled extensions, cleared mobile app cache, logged out and back in, different browsers, etc. as applicable
(an item can be marked as "complete" by reacting with the appropriate number)
Information
In order to be able to effectively help you, we need you to provide clear information to show what the problem is. The exact details needed vary per case, but here is a list of things to consider:
- Your docker-compose.yml and .env files.
- Logs from all the containers and their status (see above).
- All the troubleshooting steps you've tried so far.
- Any recent changes you've made to Immich or your system.
- Details about your system (both software/OS and hardware).
- Details about your storage (filesystems, type of disks, output of commands like fdisk -l and df -h).
- The version of the Immich server, mobile app, and other relevant pieces.
- Any other information that you think might be relevant.
Please paste files and logs with proper code formatting, and especially avoid blurry screenshots.
Without the right information we can't work out what the problem is. Help us help you ;)
If this ticket can be closed you can use the /close command, and re-open it later if needed.
Successfully submitted, a tag has been added to inform contributors. :white_check_mark:
Successfully submitted, a tag has been added to inform contributors. :white_check_mark:When I was importing my library I did have a few host issues, it took a good couple of weeks and there were a couple of crashes and disk space issues which I assume could have caused it but looking for other suggestions on how file was removed from /data/uploads before it was copied to /data/library
Btw, are
/data/upload and /data/library in the same mount, like /path/to/dir:/data or are they mounted separately?
There are 2 different moving / copying approaches for these 2 cases, but anyway it is robust enough and should handle file system issues, IMO.
You can also check select * from move_history; in case if there are any unsuccessful movements.This is what I have....
225 files which appear in external which aren't in defaultDo they have anything in common? Maybe they are live photos? Re:
move_history table in the database. It is cleaned up on every run of Storage Template Migration. Therefore most likely there's nothing inside.