Thumbnail Generation Fails: bytes before restart marker
Getting this on several jpg files in an external library. The files are valid on the file system (open as expected). These are scanned files but I also have a lot of these that work fine.
[Nest] 8 - 12/18/2024, 9:22:54 AM ERROR [Microservices:JobService] Unable to run job handler (thumbnailGeneration/generate-thumbnails): Error: VipsJpeg: ./lib/jpegli/decode_scan.cc:454: Skipped 4 bytes before restart marker
VipsJpeg: ./lib/jpegli/decode_scan.cc:454: Skipped 22 bytes before restart marker
[Nest] 8 - 12/18/2024, 9:22:54 AM ERROR [Microservices:JobService] Error: VipsJpeg: ./lib/jpegli/decode_scan.cc:454: Skipped 4 bytes before restart marker
VipsJpeg: ./lib/jpegli/decode_scan.cc:454: Skipped 22 bytes before restart marker
at Sharp.toBuffer (/usr/src/app/node_modules/sharp/lib/output.js:163:17)
at MediaRepository.decodeImage (/usr/src/app/dist/repositories/media.repository.js:57:68)
at MediaService.generateImageThumbnails (/usr/src/app/dist/services/media.service.js:161:63)
at process.processTicksAndRejections (node:internal/process/task_queues:105:5)
at async MediaService.handleGenerateThumbnails (/usr/src/app/dist/services/media.service.js:111:25)
at async JobService.onJobStart (/usr/src/app/dist/services/job.service.js:148:28)
at async EventRepository.onEvent (/usr/src/app/dist/repositories/event.repository.js:134:13)
at async Worker.processJob (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:394:28)
at async Worker.retryIfFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:581:24)
5 Replies
:wave: Hey @kramttocs,
Thanks for reaching out to us. Please carefully read this message and follow the recommended actions. This will help us be more effective in our support effort and leave more time for building Immich :immich:.
References
- Container Logs:
docker compose logs docs
- Container Status: docker ps -a docs
- Reverse Proxy: https://immich.app/docs/administration/reverse-proxy
- Code Formatting https://support.discord.com/hc/en-us/articles/210298617-Markdown-Text-101-Chat-Formatting-Bold-Italic-Underline#h_01GY0DAKGXDEHE263BCAYEGFJA
Checklist
I have...
1. :blue_square: verified I'm on the latest release(note that mobile app releases may take some time).
2. :blue_square: read applicable release notes.
3. :blue_square: reviewed the FAQs for known issues.
4. :blue_square: reviewed Github for known issues.
5. :blue_square: tried accessing Immich via local ip (without a custom reverse proxy).
6. :blue_square: uploaded the relevant information (see below).
7. :blue_square: tried an incognito window, disabled extensions, cleared mobile app cache, logged out and back in, different browsers, etc. as applicable
(an item can be marked as "complete" by reacting with the appropriate number)
Information
In order to be able to effectively help you, we need you to provide clear information to show what the problem is. The exact details needed vary per case, but here is a list of things to consider:
- Your docker-compose.yml and .env files.
- Logs from all the containers and their status (see above).
- All the troubleshooting steps you've tried so far.
- Any recent changes you've made to Immich or your system.
- Details about your system (both software/OS and hardware).
- Details about your storage (filesystems, type of disks, output of commands like fdisk -l and df -h).
- The version of the Immich server, mobile app, and other relevant pieces.
- Any other information that you think might be relevant.
Please paste files and logs with proper code formatting, and especially avoid blurry screenshots.
Without the right information we can't work out what the problem is. Help us help you ;)
If this ticket can be closed you can use the /close command, and re-open it later if needed.Seems like the files are corrupted
Would recommend using a command line tool like
convert and see if they can be processed manually
We also have an env var that will force processing of failed jobs, but may lead to issuesThanks. Odd they load up file in Windows. Will see about mass converting them
I ran it through xnconvert and that took care of it. Thanks again
Windows can load corrupted files, you will see artifacts if the corrupted bytes amount enough on screen
Good to know. No idea what is unique about these as they all (working and non working) came from an epson photo scanner. Either way, just batched the whole folder through xnconvert and all good. No visible issues at least in my spot checking at all thumbnails generate.