Randomly, a couple images on the mobile app stop loading
Very strange issue I've seen since I first deployed Immich and as I haven't seen other reports of it I'm trying to figure out what could possibly be causing it.
When I open the mobile app (iOS or Android) all pictures work just fine. But if I start swiping left and right from picture to picture, go back to the main timeline view, etc. eventually a picture or two or three will only show this when viewed. The moment I close the app and relaunch it, those specific pictures work fine again until the next time it happens. It's not the same pictures that do it each time, either, so it wouldn't strike me as a file issue. The issue never occurs on the desktop, so it wouldn't strike me as a server/config issue. And when I first deployed Immich I still saw the issue even when trying to access directly via IP, which would seem to rule out reverse proxy issues. Anyone know what else I could be missing here?
When I open the mobile app (iOS or Android) all pictures work just fine. But if I start swiping left and right from picture to picture, go back to the main timeline view, etc. eventually a picture or two or three will only show this when viewed. The moment I close the app and relaunch it, those specific pictures work fine again until the next time it happens. It's not the same pictures that do it each time, either, so it wouldn't strike me as a file issue. The issue never occurs on the desktop, so it wouldn't strike me as a server/config issue. And when I first deployed Immich I still saw the issue even when trying to access directly via IP, which would seem to rule out reverse proxy issues. Anyone know what else I could be missing here?
54 Replies
:wave: Hey @Campapalooza,
Thanks for reaching out to us. Please carefully read this message and follow the recommended actions. This will help us be more effective in our support effort and leave more time for building Immich :immich:.
References
- Container Logs:
docker compose logs docs
- Container Status: docker ps -a docs
- Reverse Proxy: https://immich.app/docs/administration/reverse-proxy
- Code Formatting https://support.discord.com/hc/en-us/articles/210298617-Markdown-Text-101-Chat-Formatting-Bold-Italic-Underline#h_01GY0DAKGXDEHE263BCAYEGFJA
Checklist
I have...
1. :ballot_box_with_check: verified I'm on the latest release(note that mobile app releases may take some time).
2. :ballot_box_with_check: read applicable release notes.
3. :ballot_box_with_check: reviewed the FAQs for known issues.
4. :ballot_box_with_check: reviewed Github for known issues.
5. :ballot_box_with_check: tried accessing Immich via local ip (without a custom reverse proxy).
6. :ballot_box_with_check: uploaded the relevant information (see below).
7. :ballot_box_with_check: tried an incognito window, disabled extensions, cleared mobile app cache, logged out and back in, different browsers, etc. as applicable
(an item can be marked as "complete" by reacting with the appropriate number)
Information
In order to be able to effectively help you, we need you to provide clear information to show what the problem is. The exact details needed vary per case, but here is a list of things to consider:
- Your docker-compose.yml and .env files.
- Logs from all the containers and their status (see above).
- All the troubleshooting steps you've tried so far.
- Any recent changes you've made to Immich or your system.
- Details about your system (both software/OS and hardware).
- Details about your storage (filesystems, type of disks, output of commands like fdisk -l and df -h).
- The version of the Immich server, mobile app, and other relevant pieces.
- Any other information that you think might be relevant.
Please paste files and logs with proper code formatting, and especially avoid blurry screenshots.
Without the right information we can't work out what the problem is. Help us help you ;)
If this ticket can be closed you can use the /close command, and re-open it later if needed.
Successfully submitted, a tag has been added to inform contributors. :white_check_mark:Do you mind try logout and log back in?
Sure thing, I just did. Should I just keep monitoring it? I'm pretty sure it will continue as it persisted even after I switched from Android to iOS a couple months back (which obviously required re-signing in), but being intermittent it's hard to ever be certain until I give it some time.
hmm
When you run into the issue again can you export the log and share it here?
I'm sorry...I wish I could give a better "it seems to happen more when I do xxxx" but it's been super intermittent. And yes I absolutely can do that!
No problem
thank you for reporting
@Alex I finally managed to get the issue to replicate itself again, and when I clicked my profile pic > logs this is what I was shown. Any chance this helps at all?
@Alex Got it to do it again, here’s more logs…
@Alex I’m sorry not trying to be impatient, just curious if there’s anything you can see in the logs that I might try to ease this issue. The way it current sits is a reverse proxy between client and server…but I don’t think anything is suspect with that because at one point earlier on while testing I was able to replicate the same issue when connecting direct via server IP locally.
Also got several other services behind the same reverse proxy with valid SSL etc. and no issues. Thoughts?
I guess it is a caching issue 🧐
Does it happen on an Android phone?
Can you try unselect any album for backup and try swiping on the cloud only assets?
@Alex Yes it happened on my old phone (S24 Ultra, which I desparately miss lol) and my current one (iPhone 15 PM). And yes next time it happens I will give that a shot. Thank you!!
So it just happened again, but after re-reading your last message I realized the assets this is occurring on are already cloud backed up...so does that change what you'd like me to try? More logs attached
Does it happen on a specific image? this is pretty strange, like edge case bug
Nope, seems entirely randomly. It'll happen on an image and then if I close the app and re-open it'll work (that image and all others) like nothing ever happened
Is there any way to enable any sort of extended debugging log that might help pinpoint where/why this is occurring?
@Alex I enabled "finest" logging in the app and replicated the issue again - these logs don't provide any more info to point to where this break might be occuring I don't suppose?
yeah finest doens't provide more info
what is your phone model again?
Happened on my old Galaxy S24 Ultra, and my current iPhone 15 PM.
Same exact issue, so I don't think it's a phone issue. Running Immich container on an Ubuntu VM, with data directory pointed at a mounted CIFS share backed by Unraid. That's about the only major thing I haven't eliminated yet; been a bit busy with other life stuff lately lol
I did try mounting the share in Ubuntu via both traditional /etc/fstab entry as well as autofs, but that didn't make any difference either
I am betting this is like FS issue
as this is the only instance that get reported
I mean...the IT/troubleshooting side of me would tend to agree...but I find it interesting that the web app works absolutely flawlessly...I've never seen the issue there and I use it just as much as the mobile app. So yeah I'm still not sure.
hmm
Are these photos those that used to be on device, but were later removed from outside Immich?
We have a known issue where the app tries to use the local version of the asset, even after it is being removed on device
@shenlong-tanwen What do you mean by "removed from outside immich"? Like they were on-device, and then from within Immich you deleted them from device after they'd been uploaded?
Like like they get uploaded, and then some other program or process deletes them from the filesystem?
What I wanted to know was, whether the assets were on the device locally, got uploaded to Immich and then deleted from the phone gallery or something, outside Immich.
@shenlong-tanwen I'll keep an eye on that but 98% of all the photos I delete, I delete from within the Immich app so I don't think that's what's going on here. I played around last night with mounting my Nas cifs share directly via the docker container rather than a mount point on the Ubuntu host OS....trying to figure out if that made any difference or not. The intermittent nature of this problem makes it hard to troubleshoot.
I also have this issue, but very infrequently. I usually notice it because a memory won't load, I go to the memory, photo won't load either. When I reopen the app or view from web it's fixed.
Crazy…I’m not really sure what to make of it at this point. Mine is pretty infrequent too, and where I’m currently at is either the mobile app has a edge case bug that’s yet to be discovered, or some sort of network latency or delay or something with my Immich upload directory is making the mobile app unhappy on rare occasion and it doesn’t handle it very gracefully.
If I may ask, what does your Immich data directory (like the upload location) setup look like? My Immich docker container runs on an Ubuntu ESXi VM, and within the docker compose file I have a defined mount point to my Unraid NAS CIFS share.
Any of that sound similar to your setup by chance? Whatever is going on here seems to be exceptionally edge case and difficult to pin down, so any data points might help 🙂
I'm running OpenMediaVault, Docker on top with Immich. No VMs. However the DB and Upload Location is on a RAID5 with 4x 2TB HDDs
Interesting….yeah that seems like it would be pretty direct and reasonably quick access
Quick updates on this. I can't help but feel like there's some sort of major bug with the mobile app...since the website works flawlessly.
It's not mobile OS, as both Android and iOS exhibit identical issues. It's not my reverse proxy setup, as connecting on LAN directly via IP results in the same issue. And it's not storage related as I transferred my entire ~100GB collection to the server on which the Immich docker is running, which itself is backed by 16 SATA SSD's in RAID-10 with a 25Gbps uplink...so reasonably fast...and the exact same bug still occurs.
As much as I hate to say it, this might be the beginning of the end of Immich for me as there's no way I'll be able to get my wife to accept having to force close and re-open the app every other time she opens it for everything to actually show up. @Alex At this point I've eliminated mobile device OS, storage backing, proxying, etc. from the reasonable source of this issue...given that web works flawlessly 100% of the time I feel I have a very strong case that there is some bug here with the mobile app. Is there any way I can install a debug-type build of any sort to help get to the bottom of where this breakdown is occuring? I have an Apple developer certificate so I can easily sideload an IPA, and I've got access to a couple Android tablets too if it needed to come from there. Just asking one last time here to make certain I have absolutely no other options before jumping ship. Appreciate any advice you have.
It's not mobile OS, as both Android and iOS exhibit identical issues. It's not my reverse proxy setup, as connecting on LAN directly via IP results in the same issue. And it's not storage related as I transferred my entire ~100GB collection to the server on which the Immich docker is running, which itself is backed by 16 SATA SSD's in RAID-10 with a 25Gbps uplink...so reasonably fast...and the exact same bug still occurs.
As much as I hate to say it, this might be the beginning of the end of Immich for me as there's no way I'll be able to get my wife to accept having to force close and re-open the app every other time she opens it for everything to actually show up. @Alex At this point I've eliminated mobile device OS, storage backing, proxying, etc. from the reasonable source of this issue...given that web works flawlessly 100% of the time I feel I have a very strong case that there is some bug here with the mobile app. Is there any way I can install a debug-type build of any sort to help get to the bottom of where this breakdown is occuring? I have an Apple developer certificate so I can easily sideload an IPA, and I've got access to a couple Android tablets too if it needed to come from there. Just asking one last time here to make certain I have absolutely no other options before jumping ship. Appreciate any advice you have.
I am not sure if the debug build would help here. How many assets do you have on your instance? I wonder, if you can create a brand new instance, use the phone that ran into this issue to upload all of its assets and see if it can be reprduced?
Here are my server stats. Not small by any means but I can't imagine there's not substantially larger libraries out there.
And I'm happy to build a brand new instance, but I wouldn't be able to use the phone that ran into this issue because a) it's every single mobile device I've ever used to access it (and I usually have a new phone every ~6 months or so), and b) I often purge all locally stored images from my mobile device, as once it's backed up there's no point in it still being on device. So my only option would be to transfer the entire immich data folder again.
Which I'm more than happy to do if it helped get to the bottom of why this is occurring...but obviously it's getting tiresome when the website works absolutely flawlessly. Unfortunately that's only probably 10% of my regular access methods
the website and the mobile uses two different technologies and different method of displaying the images
Figured as much given how well one works and how garbage the other is for me. What's so strange is how the force closing and re-opening fixes it nearly every single time (for a brief period)
I would try to build a new instance, then drag and drop the library folder of the account that has only 6GB of data there to try first
also another good data point is from the server log, if you can try swiping and monitor the server logs
see if it spit out error message when it happens
You said you tested with local IP:2283 but do you have any kind of IDS, IPS, packet inspection, firewall in place on your network?
I assume by local IP you meant local IP, port 2283, but you didn’t actually say that
as well as any network segmentation, VLANs, NAT, etc
@zeus sorry, great questions I should have been clearer. Unfortunately no I have a large flat network at the moment other than my reverse proxy in DMZ. 192.168.1.x:2283 Immich accessed from 192.168.1.x on WiFi. Absolutely nothing other than a couple layer 2 switches sitting in between.
@Alex fair enough, I can give that a shot. I’ll spin up a fresh copy of Ubuntu 24.04 when I get a chance.
As for watching the server log - is that from a file in the Immich-app directory or are you saying from docker logs?
It is from the docker logs
Ok I will give that a shot and post back if I end up finding anything. Thank you
Thank you, this is a pretty strange problem tbh
So far nothing from the docker logs. Going to rebuild a brand new ubuntu 24.04 server and start as fresh as possible (new database, new users, etc.). Only thing I'm going to "restore" is using immich-go to re-upload my library
Can you check if the assets with the issue is available both on device and the server?
Or it used to be available on both and got deleted from the device at some point
I believe you asked me this same question on March 4th
support load overloaded
😄
Hahaha totally get it dude 😂😂
Knock on wood, I haven’t seen the problem since earlier today when I built a new server and new Immich instance from scratch, NAS share mounted via docker volume mapping same as before, and reuploaded all assets with Immich-go…but I’ve only opened the app maybe 3-4 times since the initial admin jobs completed so very much tbd
Yeah but have you checked if they were also available on the device as well? It doesn't matter if the asset is deleted from within Immich or from outside. There is an existing issue that results in a mismatch between the asset state due to which, thumbnails cannot be fetched from the device.
I most definitely saw the issue with assets in at minimum two of the three states - only remote, and remote + local. Can’t guarantee I saw it on any local only assets, but since I have background backup always on (cell+wifi) the number of pics I have not backed up at any given point is very small
And the bandwidth at most places I frequent is sufficient that delta backups usually happen pretty rapidly
Does that answer your question?
It does, thank you. Having the issue on Remote only assets rules out the bug I was talking about
Let me know if the issue reproduces again, we can probably add some additional logs and check them with a debug build
So the one thing I kind of forgot about was Albums...I lost a couple of those that I had created and added things to for a long time. I'm guessing those are purely stored as database relationships and so there's effectively no way to restore those correct?
I'll make do, as still knocking on wood I still haven't seen the bug re-appear...just stinks a bit lol so figure I might as well ask
Correct
I’ve been knocking since yesterday
The downstairs neighbours have started complaining 👀
Sorry i write in this case as well, but here after the latest update i have noticed the when looking in the memories at the top of the android app, that some pictures don't show and if it can't show the next few pictures then the app slows down my phone and crashes the app, and then my homescreen also have to reload my apps and widgets.
This have also never happend for me, but it sounds like it could be related to what this case is about 🤷
Can you check on the web what type of file for that first asset? Livephotos, video or image
It's usally when it's a videoer, but a few times it's also photos
@KristianHS how long have you had Immich set up, and how long have you been noticing this issue?
Also, Is there any chance you original set up Immich using Immich-Go to migrate from a google photos takeout?
I have been using immich for about a year now i think, but i have just noticed this behavior after the latest update.
I have immich running with docker compose followed by the instructions from the documentation
Interesting ok.
So another data point on this @Alex and @shenlong-tanwen. I’m not sure what it means, but if there is a bug here I still want to help resolve it. To date, I haven’t seen the issue reoccur under my profile on new server.
HOWEVER, I have been pushing my wife for over a year to migrate from GPhotos (only this issue has been holding me back from making it happen), so 3 days ago I did a takeout of all her photos, and used Immich-go to upload the 3 .zip files Google created me.
I then signed into her Immich account on my phone to keep an eye out for the issue. The first day and a half or two days I didn’t notice it that I can tell - I did notice sometime the latest thumbnails wouldn’t load but it didn’t feel like the same issue - it felt like Immich was still trying to process everything from her massive 140GB library. As near as I can tell, every job (including ML) finished entirely around Thursday night.
Then yesterday afternoon I re-experienced the same bug again. So I’m not sure what that means.
I went ahead and deleted her Immich user, and am still waiting for that to complete. Once it does, I’m going to do the exact same upload I did by using Immich-go but with the from-folder option rather than Google Takeout and see what happens.
Anecdotally, I did notice a post over in another channel that sounds like the same issue too, but that user says something about a sql upgrade fixing it. Idk. The way this issue has behaved for me is that it randomly fixes itself.
