240 k duplicates of 80k images immich_server | PayloadTooLargeError: request entity too large
Im running immich on docker
Immich
v1.131.3
ExifTool
13.00
Node.js
v22.14.0
Libvips
8.15.3
ImageMagick
7.1.1-40
FFmpeg
7.0.2-7
Repository
immich-app/immich
Quellcode
v1.131.3@00d3b8d83
Build
14207567865
Build Abbild
v1.131.3
Versionshistorie
1.131.3 am 11. Apr. 2025 installiert
1.127.0 am 26. Feb. 2025 installiert
1.126.1 am 26. Feb. 2025 installiert
the docker host has 6 cpu (i5) and 32GB
i encountr an internal server error:
I have ~240 000 duplicates in ~80 images.
Imossible to delete them indvidually.
If i klick on Remove all duplicates
i get:
immich_server | at processParams (/usr/src/app/node_modules/router/index.js:574:12) immich_server | at next (/usr/src/app/node_modules/router/index.js:288:5) immich_server | at cookieParser (/usr/src/app/node_modules/cookie-parser/index.js:71:5) immich_server | [Nest] 15 - 04/18/2025, 9:05:06 AM ERROR [Api:GlobalExceptionFilter] Unknown error: PayloadTooLargeError: request entity too large immich_server | PayloadTooLargeError: request entity too large I have already tweaked docker mem_limit: 24g cpus: 4.0 environment: - PAYLOAD_LIMIT=1000mb but dosen't help what else can i do?
immich_server | at processParams (/usr/src/app/node_modules/router/index.js:574:12) immich_server | at next (/usr/src/app/node_modules/router/index.js:288:5) immich_server | at cookieParser (/usr/src/app/node_modules/cookie-parser/index.js:71:5) immich_server | [Nest] 15 - 04/18/2025, 9:05:06 AM ERROR [Api:GlobalExceptionFilter] Unknown error: PayloadTooLargeError: request entity too large immich_server | PayloadTooLargeError: request entity too large I have already tweaked docker mem_limit: 24g cpus: 4.0 environment: - PAYLOAD_LIMIT=1000mb but dosen't help what else can i do?
14 Replies
:wave: Hey @ufehembach,
Thanks for reaching out to us. Please carefully read this message and follow the recommended actions. This will help us be more effective in our support effort and leave more time for building Immich :immich:.
References
- Container Logs:
docker compose logs docs
- Container Status: docker ps -a docs
- Reverse Proxy: https://immich.app/docs/administration/reverse-proxy
- Code Formatting https://support.discord.com/hc/en-us/articles/210298617-Markdown-Text-101-Chat-Formatting-Bold-Italic-Underline#h_01GY0DAKGXDEHE263BCAYEGFJA
Checklist
I have...
1. :blue_square: verified I'm on the latest release(note that mobile app releases may take some time).
2. :blue_square: read applicable release notes.
3. :blue_square: reviewed the FAQs for known issues.
4. :blue_square: reviewed Github for known issues.
5. :blue_square: tried accessing Immich via local ip (without a custom reverse proxy).
6. :blue_square: uploaded the relevant information (see below).
7. :blue_square: tried an incognito window, disabled extensions, cleared mobile app cache, logged out and back in, different browsers, etc. as applicable
(an item can be marked as "complete" by reacting with the appropriate number)
Information
In order to be able to effectively help you, we need you to provide clear information to show what the problem is. The exact details needed vary per case, but here is a list of things to consider:
- Your docker-compose.yml and .env files.
- Logs from all the containers and their status (see above).
- All the troubleshooting steps you've tried so far.
- Any recent changes you've made to Immich or your system.
- Details about your system (both software/OS and hardware).
- Details about your storage (filesystems, type of disks, output of commands like fdisk -l and df -h).
- The version of the Immich server, mobile app, and other relevant pieces.
- Any other information that you think might be relevant.
Please paste files and logs with proper code formatting, and especially avoid blurry screenshots.
Without the right information we can't work out what the problem is. Help us help you ;)
If this ticket can be closed you can use the /close command, and re-open it later if needed.PAYLOAD_LIMIT=1000mbWhat is this?
following chatGPT this should increase the payload limit of node
Lösungswege
🔧 1. Erhöhe die erlaubte Payload-Größe in Immich (Node.js-Server)
Da Immich in Docker läuft, kannst du die maximale Request-Größe erhöhen, indem du das Limit im Node.js-Backend änderst.
Das passiert meist über den body-parser-Middleware in NestJS.
Da Immich in /usr/src/app läuft, kannst du versuchen, eine CUSTOM_PAYLOAD_LIMIT zu setzen:
➤ docker-compose.override.yml erstellen:
yaml
Kopieren
Bearbeiten
services:
immich-server:
environment:
- PAYLOAD_LIMIT=100mb
Wenn das nicht greift, brauchst du einen direkten Patch in Immich (z. B. Fork oder PR – aber unwahrscheinlich nötig). Meist reicht ein Environment-Wert, weil NestJS das im Startup konfiguriert.
Chatgpt is completely making stuff up, that isn't something that exists
Are you using a reverse proxy?
nope, it's local, when i'm remote I use twingate
What did you even do to get 240k duplicates of 80k images
ok, good point, nothing to do with the problem but:
3 kids, 25 years of digital photos, whatsapp saving all images in images, synced to synology, mixed up, modified, so ending up in a 5 year lasting cleanup operations with now 5TB /900000 images in serveral folders.Immich convinced me as it is able to determine the best image while uploading and not importing the rest, so I'm now down to 1,2 TB.
found the duplicate tool in immich quite quick and reliable, so started it.
deleted the first 1000 images now manually, but this is not what IT is for!
Oof that's a big library downsize indeed
Are you using a local proxy @ufehembach ?
Wait you just answered that 😅
See also https://github.com/immich-app/immich/discussions/14529
It may be that for over a certain amount of duplicates the UI really doesn't scale
thanks for the quick reply.
was not able to find somting in the discussions, mayby my enlish is an obstacle there.
so shift c is deleting ? Was not clear to me from the gui, is a good was to get around it that way (with the cup)
I mostly linked it to show that it's not you, it's immich
I didn't know about shift+c either 👀
This is how I do it!!
