Syncing from phone after using google take-out import
Hello friends! I'm in the process of migrating from google photos to immich. I love it so far! What a wonderful bit of technology.
I have successfully imported my google take-out data into immich. I want to enable immich sync from my iphone to Immich also, but I'm not sure what the right process is, and I want to avoid uploading duplicates.
On my phone I have:
1. Photos not in my google take-out (taken after I turned off google photos sync)
2. Photos in my google take-out (taken on this phone while using google photo sync)
3. Photos in my google take-out (taken on a different device but then downloaded to my phone via the google photos app)
If I enable immich sync will it know not to upload 2 and 3 to my server? Or will I need to manage duplicates in some fashion?
Thank you all!
20 Replies
:wave: Hey @lpil,
Thanks for reaching out to us. Please carefully read this message and follow the recommended actions. This will help us be more effective in our support effort and leave more time for building Immich :immich:.
References
- Container Logs:
docker compose logs docs
- Container Status: docker ps -a docs
- Reverse Proxy: https://immich.app/docs/administration/reverse-proxy
- Code Formatting https://support.discord.com/hc/en-us/articles/210298617-Markdown-Text-101-Chat-Formatting-Bold-Italic-Underline#h_01GY0DAKGXDEHE263BCAYEGFJA
Checklist
I have...
1. :blue_square: verified I'm on the latest release(note that mobile app releases may take some time).
2. :blue_square: read applicable release notes.
3. :blue_square: reviewed the FAQs for known issues.
4. :blue_square: reviewed Github for known issues.
5. :blue_square: tried accessing Immich via local ip (without a custom reverse proxy).
6. :blue_square: uploaded the relevant information (see below).
7. :blue_square: tried an incognito window, disabled extensions, cleared mobile app cache, logged out and back in, different browsers, etc. as applicable
(an item can be marked as "complete" by reacting with the appropriate number)
Information
In order to be able to effectively help you, we need you to provide clear information to show what the problem is. The exact details needed vary per case, but here is a list of things to consider:
- Your docker-compose.yml and .env files.
- Logs from all the containers and their status (see above).
- All the troubleshooting steps you've tried so far.
- Any recent changes you've made to Immich or your system.
- Details about your system (both software/OS and hardware).
- Details about your storage (filesystems, type of disks, output of commands like fdisk -l and df -h).
- The version of the Immich server, mobile app, and other relevant pieces.
- Any other information that you think might be relevant.
Please paste files and logs with proper code formatting, and especially avoid blurry screenshots.
Without the right information we can't work out what the problem is. Help us help you ;)
If this ticket can be closed you can use the /close command, and re-open it later if needed.As it works now, pictures are compared with after uploading to the server, at which point duplicates are rejected
I would use #immich-go to bulk upload the takeout, and then turn on foreground uploading on your phone
The phone WILL upload everything, the server will reject it, and the phone will mark them as uploaded/duplicate
Client-side hashing to prevent uploads is coming, but not there yet
Great, thank you!
Appreciate it
Oh wow. So i'll need to start a sync at home on wifi and wait until it finishes before leaving the house.
from personal recent experience:
- yea, works fine and deduplicates accurately and quickly
- immich-go handles the takeout quite well (I used .tgz and had to unzip them all first, use .zip if you want to skip that unzip step)
- ..... oddly immich-go's
--tag asdf at takeout-upload-time gradually gets lost after the upload completes and immich catches up on the backlog.
^ that last one is what I'm trying to figure out over in https://discord.com/channels/979116623879368755/1382180323533787197
but if that tag isn't important to you, everything else seems to be working fine for me with ~18k photos and a couple hundred on my phone.
oh, and: I'm not entirely sure why, but it doesn't seem to work quite right when you only do part of a Takeout. things missing from albums, some kind of weird progress-bar issue that might mean it's skipping uploads, etc.
AFAICT it needs to be all or nothing. there might be some takeout-zip-content reason for that, the takeout archive files are definitely a bit weird if you look closely at them. albums spread across multiple zips, and maybe also metadata? idk.That last zip file in my takeout was very small and immich-go claimed "useless file" but it did seem to have some album meta data in there somehow.
Be careful that if you are normal person and have been using Google Photos with reduced quality settings not to have it filled super quickly then this WILL NOT work! The photos in your takeout will be considered different then the ones in your phone, because of the different file size! I did not realize this and now ended up with thousands of duplicates. So just have this in mind.
I have been using reduced quality. I just finished my phone backup. I'm not seeing duplicates.
The duplicate utility should be able to spot those as they're pretty much perfectly visually similar
oh yeah. found em. i was clicking furiously until I saw the de-duplicate all button . hehe
please let us know if it managed to remove all duplicates or you still find some, because in my case it seems this tool is kind of lazy and ignores thousands of doubled or even tripled photos
Did you check the distance for the deduplication tool? https://my.immich.app/admin/system-settings?isOpen=machine-learning+duplicate-detection
another question: I suppose this tool does not work on videos right?
I can't answer that with certainty
well. Maybe changing that distance settings would do something. Look at these photos and tell me what distance settings you think should be enough for the tool to decide that they are duplicates please
I suggest you play around with the distance a bit to see.
sorry that I hijacked this thread, but probably it does not matter. You can see that even the filesizes are almost the same here
filesize doesn't matter, just content. But yes these should be picked up
I think it's clear what I mean - these photos look the same and the filesize is very similar, so they are almost identical by the content 😉
two of those photos were even automatically stacked by Immich
continuing here
https://discord.com/channels/979116623879368755/1382821343979896882