Timeline of events:
1. Initially setup immich on 1TB internal ssd, realised it was not going to be enough and copied (rsycnc -avh /source /desination) the data to an external ssd
2. started using the external ssd and realised it gets disconnected quite frequently, turned out usb protocol is not as stable for running 24 hours or maybe its just that extreme ssd that I had bought was the issue, (rsycnc -avh /source /desination) all the files from external ssd to an internal ssd of 2TB.
3. Internal SSD (2tb) working fine for a while but later realised alot (mostly all images/videos) were duplicated (atleast 3 copies), spinned up a remote machine learning instance to clean up duplication,
4. After remote ML setup (running on default immich ML configuration) still lot if not all of duplicates exist, timelines are all messed up (90% of the photos/videos are in 2025-2024 timeline)
How do I fix this issue? Is starting from scratch my only option?