I
Immich•5mo ago
Shlappas

Issue with duplicate .HEIC [immich-server v1.123.0]

I started using Immich recently, and I initially enabled backup from my iPhone, before doing a google takeout and using google-photos-migrate to upload the photos from my google account. There are several "live photos" (is this an apple trademark?) and since I have been syncing my photos from my phone to google, there were ~2000 duplicate files. After using the de-duplication utility, it appears that only the thumbnail for these duplicates was removed, and the video portion remained. These now appear in my library as "Error loading image". Since they are duplicates, there are perfectly fine copies of each image as well - for example, I took 2 photos on Monday the 18th of November, my library now shows 4 entries on that date, where two of them have broken thumbnails, but share the video content of the two with working thumbnails. If I try to run "refresh thumbnails" on one of these files, the server outputs the error message below: (in subsequent comment) Since they are duplicates, my current ideal solution involves just removing the files from my library with broken thumbnails. I'm not sure whether nuking the library and re-uploading will help here, because I would still need to resolve the duplicate video issue. Perhaps doing the google-takeout import first will not put me in the same situation, though?
3 Replies
Immich
Immich•5mo ago
:wave: Hey @Shlappas, Thanks for reaching out to us. Please carefully read this message and follow the recommended actions. This will help us be more effective in our support effort and leave more time for building Immich :immich:. References - Container Logs: docker compose logs docs - Container Status: docker ps -a docs - Reverse Proxy: https://immich.app/docs/administration/reverse-proxy - Code Formatting https://support.discord.com/hc/en-us/articles/210298617-Markdown-Text-101-Chat-Formatting-Bold-Italic-Underline#h_01GY0DAKGXDEHE263BCAYEGFJA Checklist I have... 1. :ballot_box_with_check: verified I'm on the latest release(note that mobile app releases may take some time). 2. :ballot_box_with_check: read applicable release notes. 3. :ballot_box_with_check: reviewed the FAQs for known issues. 4. :ballot_box_with_check: reviewed Github for known issues. 5. :ballot_box_with_check: tried accessing Immich via local ip (without a custom reverse proxy). 6. :ballot_box_with_check: uploaded the relevant information (see below). 7. :ballot_box_with_check: tried an incognito window, disabled extensions, cleared mobile app cache, logged out and back in, different browsers, etc. as applicable (an item can be marked as "complete" by reacting with the appropriate number) Information In order to be able to effectively help you, we need you to provide clear information to show what the problem is. The exact details needed vary per case, but here is a list of things to consider: - Your docker-compose.yml and .env files. - Logs from all the containers and their status (see above). - All the troubleshooting steps you've tried so far. - Any recent changes you've made to Immich or your system. - Details about your system (both software/OS and hardware). - Details about your storage (filesystems, type of disks, output of commands like fdisk -l and df -h). - The version of the Immich server, mobile app, and other relevant pieces. - Any other information that you think might be relevant. Please paste files and logs with proper code formatting, and especially avoid blurry screenshots. Without the right information we can't work out what the problem is. Help us help you ;) If this ticket can be closed you can use the /close command, and re-open it later if needed.
Shlappas
ShlappasOP•5mo ago
error message: 
[Nest] 7  - 12/23/2024, 1:27:52 PM   ERROR [Microservices:JobService] Unable to run job handler (thumbnailGeneration/generate-thumbnails): Error: Input file contains unsupported image format
[Nest] 7  - 12/23/2024, 1:27:52 PM   ERROR [Microservices:JobService] Error: Input file contains unsupported image format
    at Sharp.toBuffer (/usr/src/app/node_modules/sharp/lib/output.js:163:17)
    at MediaRepository.decodeImage (/usr/src/app/dist/repositories/media.repository.js:57:68)
    at MediaService.generateImageThumbnails (/usr/src/app/dist/services/media.service.js:161:63)
    at process.processTicksAndRejections (node:internal/process/task_queues:105:5)
    at async MediaService.handleGenerateThumbnails (/usr/src/app/dist/services/media.service.js:111:25)
    at async JobService.onJobStart (/usr/src/app/dist/services/job.service.js:148:28)
    at async EventRepository.onEvent (/usr/src/app/dist/repositories/event.repository.js:134:13)
    at async Worker.processJob (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:394:28)
    at async Worker.retryIfFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:581:24)
[Nest] 7  - 12/23/2024, 1:27:52 PM   ERROR [Microservices:JobService] Object:
{
  "id": "8a3ff21c-a1d5-415a-bdcd-cb604f9f2645"
}
[Nest] 7  - 12/23/2024, 1:27:52 PM   ERROR [Microservices:JobService] Unable to run job handler (thumbnailGeneration/generate-thumbnails): Error: Input file contains unsupported image format
[Nest] 7  - 12/23/2024, 1:27:52 PM   ERROR [Microservices:JobService] Error: Input file contains unsupported image format
    at Sharp.toBuffer (/usr/src/app/node_modules/sharp/lib/output.js:163:17)
    at MediaRepository.decodeImage (/usr/src/app/dist/repositories/media.repository.js:57:68)
    at MediaService.generateImageThumbnails (/usr/src/app/dist/services/media.service.js:161:63)
    at process.processTicksAndRejections (node:internal/process/task_queues:105:5)
    at async MediaService.handleGenerateThumbnails (/usr/src/app/dist/services/media.service.js:111:25)
    at async JobService.onJobStart (/usr/src/app/dist/services/job.service.js:148:28)
    at async EventRepository.onEvent (/usr/src/app/dist/repositories/event.repository.js:134:13)
    at async Worker.processJob (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:394:28)
    at async Worker.retryIfFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:581:24)
[Nest] 7  - 12/23/2024, 1:27:52 PM   ERROR [Microservices:JobService] Object:
{
  "id": "8a3ff21c-a1d5-415a-bdcd-cb604f9f2645"
}
potentially related: - https://github.com/immich-app/immich/issues/14349 - My thumbnail jobs are not hanging, though, they just fail with the above error message. System details: - running in k8s with the helm chart - values: 
  "env":
    "DB_DATABASE_NAME": "immich"
    "DB_HOSTNAME": "immich-db-rw"
    "DB_USERNAME": "immich"
  "image":
    "tag": "v1.123.0"
  "immich":
    "persistence":
      "library":
        "existingClaim": "immich-library"
  "machine-learning":
    "enabled": true
    "image":
      "tag": "v1.123.0-cuda"
    "persistence":
      "cache":
        "accessMode": "ReadWriteOnce"
        "enabled": true
        "storageClass": "local-path"
        "type": "pvc"
    "resources":
      "limits":
        "nvidia.com/gpu": "1"
      "requests":
        "nvidia.com/gpu": "1"
    "runtimeClassName": "nvidia"
  "redis":
    "enabled": true
  "server":
    "enabled": true
  
  "env":
    "DB_DATABASE_NAME": "immich"
    "DB_HOSTNAME": "immich-db-rw"
    "DB_USERNAME": "immich"
  "image":
    "tag": "v1.123.0"
  "immich":
    "persistence":
      "library":
        "existingClaim": "immich-library"
  "machine-learning":
    "enabled": true
    "image":
      "tag": "v1.123.0-cuda"
    "persistence":
      "cache":
        "accessMode": "ReadWriteOnce"
        "enabled": true
        "storageClass": "local-path"
        "type": "pvc"
    "resources":
      "limits":
        "nvidia.com/gpu": "1"
      "requests":
        "nvidia.com/gpu": "1"
    "runtimeClassName": "nvidia"
  "redis":
    "enabled": true
  "server":
    "enabled": true
Troubleshooting steps so far: - restarting the pod and executing the generate all thumbnails job Both mobile app and server are at the same version (1.123.0)
Immich
Immich•5mo ago
Successfully submitted, a tag has been added to inform contributors. :white_check_mark:

Did you find this page helpful?