Immich seems to think some assets are duplicates?
Does anyone have an idea why immich thinks that more than 50% of my files are duplicates?
When I select the Backup Albums it says that my Recent album has 5488 assets. Then it claims that there are 2341 unique assets which I know is not true. Thus preventing 3k files from backing up.
The files have unique names and are mostly photos taken with the camera of the phone.
34 Replies
is this on iOS or Android?
Android
Can you try to uninstall and reinstall the app?
Sure brb
Huh that did it
Thanks Alex!
I guess you know exactly why it happens then 🙂 anything i could do to prevent it from seeing them as duplicate in the future?
Hmm so something has gone wrong with the indexing and saving to the local database
We are in the process of refactor some of that indexing part, so this won't be applied in the near future.
Sounds good 👍
Good job on the project - it's amazing
No problem! Enjoy 🙂
Ok so there seems to be something else going on
While it initially recognized that there's 5488 unique assets
As it progress through the upload process, the unique asset counter goes down
Along with the Remainder counter
But the backup counter remains unchanged
Weird eh
Did you already have upload some of the assets that potentially in the album on the phone through the web or through CLI?
Yes, they were uploaded through the app before
It is also possible to check the server and microservices container log to see if there were any error
I had uploaded some older photos through CLI but those aren't on the phone
I'll check the server logs now
okay
The only error in the app log is a HiveError: Box Not Found
I'll see the server side
Yeah the server side would be more applicable in this case
I run it in Docker on Unraid
There are no errors in the log
Any other place I could check?
Is this the all in one image?
You mean as in db+immich in a single image?
How do you install Immich on unraid, is it through the community image or through Docker-compose?
Community image
Hmm then I am not sure
Can you show the screenshot of the log?
No noticeable error about upload, just weird error about Redis client which I don’t know why
Do you mind create a new instance and try again so see if you have the same issue? I suspect there are duplicated from the already uploaded asset before
That's it, I'm trying to resolve the Redis error but I can't quite figure it out yet.
I suggest you follow this guide for better support https://immich.app/docs/install/unraid
Unraid | Immich
Immich can easily be installed and updated on Unraid via:
Using docker-compose
docker-compose it is then 🙂
almost there, immich proxy has a port assignment of 2283(same as community, which I stopped), when i try to open it I get ECONNREFUSED
any idea? should I completely remove the community image?
all good - I was using the wrong DB password. let's see what happens now
I am experiencing something similar as well
I'm on android (play store). I have a couple albums selected which should total 157 assets
But it only says 97 unique assets
I am relatively confident that there are no duplicates
I am hesitating moving the entire google photos album over (as a test upload ofc, I realize this app is still in the early phases) until this is sorted out
Didn't know they could go negative?! 😁 But at least it looks like everything is backed up properly now on the new instance. I'll try to do an upload through CLI where I'll have some duplicates to see what happens
negative is a bug that I wanted to fix for so long but still haven't found the root cause yet. Now it is just a cosmetic bug
Do you think that having the negative value is related to my issues of having the incorrect asset count?
(Mine does not have a negative value btw, it did on the first install but I wiped and now the total count is just wrong)
I think it is related on the duplicated/unique asset indexing implementation
we are refactoring this part in the next couple release so I hope to resolve this one soon
it has been bugging me since forever but I haven't been able to track down the root cause. I myself don't experience it but a lot of other people run into this issue.
Just adding to that this fixed my issue with Immich as well. Immich though all assets were duplicates and was in a upload loop. MD was iPhone
Version 1.53.0 build.93