Photos not showing up since update - Storage showing 80Gb
Hi, i finally got around to moving up to the latest version. I am very new to truenas so was abit daunting to set up new data sets and rsync everything across. I thought everything went ok with no obvious errors, however when i logged in i found a fresh set up, no photos. Weirdly the storage space in the bottom left shows 80GiB of data used.
I foolisly tried to figure it out myself, and attempted some chatgpt fixes (which probably made things worse)
Kind of stuck what to try now.
99 Replies
:wave: Hey @Fourshadow,
Thanks for reaching out to us. Please carefully read this message and follow the recommended actions. This will help us be more effective in our support effort and leave more time for building Immich :immich:.
References
- Container Logs:
docker compose logs docs
- Container Status: docker ps -a docs
- Reverse Proxy: https://immich.app/docs/administration/reverse-proxy
- Code Formatting https://support.discord.com/hc/en-us/articles/210298617-Markdown-Text-101-Chat-Formatting-Bold-Italic-Underline#h_01GY0DAKGXDEHE263BCAYEGFJA
Checklist
I have...
1. :ballot_box_with_check: verified I'm on the latest release(note that mobile app releases may take some time).
2. :ballot_box_with_check: read applicable release notes.
3. :ballot_box_with_check: reviewed the FAQs for known issues.
4. :ballot_box_with_check: reviewed Github for known issues.
5. :ballot_box_with_check: tried accessing Immich via local ip (without a custom reverse proxy).
6. :blue_square: uploaded the relevant information (see below).
7. :ballot_box_with_check: tried an incognito window, disabled extensions, cleared mobile app cache, logged out and back in, different browsers, etc. as applicable
(an item can be marked as "complete" by reacting with the appropriate number)
Information
In order to be able to effectively help you, we need you to provide clear information to show what the problem is. The exact details needed vary per case, but here is a list of things to consider:
- Your docker-compose.yml and .env files.
- Logs from all the containers and their status (see above).
- All the troubleshooting steps you've tried so far.
- Any recent changes you've made to Immich or your system.
- Details about your system (both software/OS and hardware).
- Details about your storage (filesystems, type of disks, output of commands like fdisk -l and df -h).
- The version of the Immich server, mobile app, and other relevant pieces.
- Any other information that you think might be relevant.
Please paste files and logs with proper code formatting, and especially avoid blurry screenshots.
Without the right information we can't work out what the problem is. Help us help you ;)
If this ticket can be closed you can use the /close command, and re-open it later if needed.
Yeah never chatGPT for stuff you don't know like this
While this seems correct, I think you miss rsynced the database (if you rsync it at all)
Could you also share your old dataset structure please ?
yeah i should have know better.
Its the old format
did you rsync you "db" folder? As it looks like it's the actual one that contains a databse?
Could you cd into this db and do
ll inside and share the output?
same for the pgData herei thought i did rsync the db folder, but not sure now.
I don't know either
On which Immich version were you on before migrating if you remember?
It's just to see if I make you modify something else before fixing this
I am not sure to be honest, was up to date untill it wouldnt update untill i changed the datasets. If that helps.
Ok so you were on almost latests that's fine
Wait, but that's "postreg_data" not "db" what is the content of the "db" dataset?
I have no idea how i have done that. I think i tired to follow a few different guides i came across. Best guess is each guide named it something different. But not sure.
Maybe, but can you cd into your "db" dataset and do the
ll there please?db is the first one i posted above
Oooh ok
oh wait a sec, thats the old dataset.
let me redo, my bad
Yes, but I think that's the Issue
you did not rsync the "db" to "pgData"
well show me the content of pgData also
so thats the new data sets
and if you cd into one of the datasets? can you also share the content?
sure, this cd into the backups
Yeah ok, so that might just be the rsync of the database that "went wrong"
so stop the immich app
cd in the new "pgData"
once in it do
rm -r ./
then
ok done that.
Guessing restart immich app?
can you fist ls again
in the pgData ?
and maybe do du -sh also in there while you're at it
It's just to double check that the correct files were moved
du -sh returns 592M
Yeah, that's seem more like it
as it was db here reports 431
Try to start immich again
i get a failed when it starts.
[EFAULT] Failed 'up' action for 'immich1' app. Please check /var/log/app_lifecycle.log for more details
can you show the permissions on pgData?
When you click on it, there is a widget on the right with Permissions
Not these
I meant on the dataset page
ah sorry
Could you click on "edit" then "strip acl"
done
then set them like
so you edit again and you copy that before clicking on sve
So ends up like that>
Yep so try to start your app again
Awesome its back...
Nice
:immich: 👍
Can you try to download images/video from different time point though?
Just to double check that library/upload was moved correctly?
Yeah just did a pic from 8 years ago, downloads to my download folder on windows
I rather make sure 100% than have you delete the old datasets and that for some reason you did not properly rsync the lib
Then nice, it's fixed
The rsync might have needed a sudo for the database (the guide will be updated for that)
Appreciate the help. I should of came here sooner then try and sort it myself. Really big thankyou for your time.
No problem
And that's fine, you did not mess thing up as you kept the old stuff
But chatGPT for Immich isn't good as it changes a lot
haha yeah leason learnt 🙂
so safe to delete the old dataset then you think?
In theory, yes
wait
Why do you have "data" in "immich" ? The "old" one I mean ?
I think at one point when i was trouble shooting i went to copy back data from the new dataset back into the old.
Did you do a mv command at some point?
Because your "data" is two times the size of "library" but at the same time the "video" dataset is empty
dont think i did mv (Cause i dont know what it does. Still learning linux).
I remember when i first started to troubleshoot i tried to just copy the data over from withing windows.
Can you just cd into your new "data"
and do
du -h --max-depth=1
1.3G ./backups
40G ./library
210K ./profile
36G ./upload
Wonder if this is it. When it wasnt working i opened the iphone app and logged in, it started reuploading some of my phone photo album again.
Oh well
Yes
I might have uploaded EVERYTHING of your iPphne
Do you happen to have 36gb of files on it ?
nah
i stopped it within about 10 mins
4.2G ./thumbs
64M ./encoded-video
81G .
oh it was still going btw
can you cd into upload and do ls inside it again ?
https://my.immich.app/admin/users
And after that, go there
and for each user; click on the eye and show me their "id"
truenas% cd /mnt/deathstar/config/immich1/data/upload
truenas% ls -h
5584ff23-20e9-4af1-a409-13b537a031c9 72777572-5e58-482b-afe0-331a0eb77244 d2b2d776-f5c2-4789-a933-dc1aec0132b4 e2f3c0e8-d189-44eb-9548-b5e74ad4b4df
truenas%
3
3 users
ok so inside your data/upload
can you cd into
d2b2d776-f5c2-4789-a933-dc1aec0132b4
and do du -sh there also
259M
ok so cd ../
and you can rm this one
so
rm -r d2b2d776-f5c2-4789-a933-dc1aec0132b4
but then, have you ever enabled the storage template in Immich?I dont recall, i set it up orginally about a year ago
can you cd into library and do also a
ls in there ?truenas% cd /mnt/deathstar/config/immich1/data/library
truenas% ls
72777572-5e58-482b-afe0-331a0eb77244 admin
du -h --max-depth=1
do this againtruenas% du -h --max-depth=1
1.2G ./72777572-5e58-482b-afe0-331a0eb77244
38G ./admin
40G .
truenas%
can you also do this command inside the /upload folder?
truenas% cd /mnt/deathstar/config/immich1/data/upload
truenas% du -h --max-depth=1
4.7G ./5584ff23-20e9-4af1-a409-13b537a031c9 16G ./72777572-5e58-482b-afe0-331a0eb77244 16G ./e2f3c0e8-d189-44eb-9548-b5e74ad4b4df 36G .
4.7G ./5584ff23-20e9-4af1-a409-13b537a031c9 16G ./72777572-5e58-482b-afe0-331a0eb77244 16G ./e2f3c0e8-d189-44eb-9548-b5e74ad4b4df 36G .
Thta's weirds
It look like for admin you have the storage template that was enabled at stom point
but not anymore
https://my.immich.app/admin/system-settings?isOpen=storage-template
Is this on or not?
yes its on
Ok, so
for each of your user, click on the eye, then edit (upper right) and set a label (it will be used as a folder name in the library folder
And after that
https://my.immich.app/admin/jobs-status
You run the storage migration job on this page (the one before the last)
Does it matter what the label is? Like the persons name ?
and my profile already has the label admin. Should i leave that?
You can change it
it doesn't really matter
and it can be changed afterwards
ok running the job
guessing this might take awhile?
It shouldn't be that long
as it just changes the "link" to each file
ah ok
ok finished running
do the du command in both upload and library again then
this one I mean
535K ./5584ff23-20e9-4af1-a409-13b537a031c9
4.9M ./72777572-5e58-482b-afe0-331a0eb77244
3.6G ./e2f3c0e8-d189-44eb-9548-b5e74ad4b4df
3.6G .
upload
truenas% cd /mnt/deathstar/config/immich1/data/library
truenas% du -h --max-depth=1
1.8M ./72777572-5e58-482b-afe0-331a0eb77244 17G ./mel 49G ./simon 4.7G ./poppy 1.5G ./admin 72G . truenas%
1.8M ./72777572-5e58-482b-afe0-331a0eb77244 17G ./mel 49G ./simon 4.7G ./poppy 1.5G ./admin 72G . truenas%
Ok
so for some reason
there might be photos/videos leftover in
Upload/e2f3c0e8-d189-44eb-9548-b5e74ad4b4df
library/72777572-5e58-482b-afe0-331a0eb77244
library/admin
As these 3 folders have been alsmot full empty, but not entirely
This means that there aren't indexed into Immich
yeah ok. I just cd into 1 of those and matched it up to the photo in the old data set.
of that folder 9 are in immich, and 4 are not.
the 4 that are not are all bad photos that i probably deleted. Would that explain it, would they be trashed from within immich?
originally
That might yeah
But for the folder in upload 4gb seems a lot
Even deleted ?
ill check, might of been alot of videos
Idk if immch moves files, while they're in the "trash" of the user
So that either that
Or some weird stuff
I would copy the content of these 3 somehwere else
Upload/e2f3c0e8-d189-44eb-9548-b5e74ad4b4df
library/72777572-5e58-482b-afe0-331a0eb77244
library/admin
Then you can delete the three entirely (shutdown Immich before, to be sure no one is uploading to them)
yeah ok will do.
Whats the command to delete these folder again. Ill come back to it tomorrow to finalise it.
rm -r full/folder/path
but take care as it won't ask for verification
and DELETE stuff
so be sure the full path is written
yeah ok.
just checking that library/admin folder. Its mainly empty folder, only 10% have 1 file in in.
just that there are 1000's of them, who knows.
I have to leave now, so can't help further
but there are linux command to list/retrive files only
all good me to, 1:30am here. Thanks again.
ok ill chatgpt it 🙂
No problem, good to help
for command like this, I would say it's "ok" but check what it does
do not simply copy paste it
understand it first
haha i have learnt that leasson