Help recovering inaccessible existing photos after upgrade

tl;dr this is a recovery question after photos became unreachable after upgrade

I was stuck in the rendering loop of 2.2.3. In the same day before logging in, I was also asked to set up an immich admin account. This is strange because I had already set-up my admin account beforehand, when I first set up my server and uploaded photos. I followed the instructions and upgraded to 2.3.1 and now my old images are inaccessible and seemingly unreachable.

However, on the mobile app (iOS) I am able to see that the photos still exist somewhere, as well as albums of some of them. I am able to see the blurred images and can initiate a download, which displays the correct file name. However, the download never completes and I cannot see the image. The server stats page on the web shows 0 photos and 0 videos, but the mobile app correctly lists that there are photos and videos stored on the server. I've attached screenshots of the iOS app state described.

What is the best way to recover my photos? I have root access on the server but I wasn't able to find where everything was being stored.

root@immich_server:/mnt/immich/immich-app/library# du
8    ./encoded-video
8    ./upload
8    ./thumbs
8    ./profile
179528    ./backups
8    ./library
179572    .


Could I leverage the backups somehow?
I've already tried following https://docs.immich.app/administration/backup-and-restore/#asset-types-and-storage-locations
tmp1.jpg
tmp2.jpg
tmp3.jpg
tmp4.jpg
tmp5.jpg
tmp6.jpg
Was this page helpful?