#thumbnail scanning job
Hello, after week of scanning, starting from like 100k, 200k, 300kk now it jumped to over 4m. i have like 170k of images on external library. can you please help me with this? thx
95 Replies
:wave: Hey @Stepe,
Thanks for reaching out to us. Please follow the recommended actions below; this will help us be more effective in our support effort and leave more time for building Immich :immich:.
References
- Container Logs:
docker compose logs docs
- Container Status: docker compose ps docs
- Reverse Proxy: https://immich.app/docs/administration/reverse-proxy
Checklist
1. :ballot_box_with_check: I have verified I'm on the latest release(note that mobile app releases may take some time).
2. :blue_square: I have read applicable release notes.
3. :blue_square: I have reviewed the FAQs for known issues.
4. :blue_square: I have reviewed Github for known issues.
5. :blue_square: I have tried accessing Immich via local ip (without a custom reverse proxy).
6. :blue_square: I have uploaded the relevant logs, docker compose, and .env files, making sure to use code formatting.
7. :blue_square: I have tried an incognito window, disabled extensions, cleared mobile app cache, logged out and back in, different browsers, etc. as applicable
(an item can be marked as "complete" by reacting with the appropriate number)
If this ticket can be closed you can use the /close command, and re-open it later if needed.Stop immich right now for starters
ok
You 💯 % have nested mounts, so post your compose and env files please
im on synology nas, installed in container manager
Could you tell me the file path of the compose file?
It's not immediately obvious from what you show here, usually what happens is your library folder is somehow mounted inside the external library or the other way around.
You didn't also mount library somewhere inside of
/volume1/homes/stepe851/Photos did you?
docker is not inside homes
photos are stored in homes/photos
didnt mount anything else
im not good at mounting anything in linux, so it was just in that yml
docker is not inside
You don't actually have a million photos or anything do you? 👀
no, tripple checked, its 170k+-
I have to go right now but you should check the library and upload folders to see if anything loops back to itself :)(
im pretty sure i dont know how to do it 🙂 so if you can help me whenewer you came back would be great, thx, cheer
s
not using upload folder right now
Just open them in file manager for starters and check the subfolders
checking filecount in immich dir it looks ok
yes, immich library dir is empty, and upload lib contains one image i uploaded as test
Strange, that would mean it's just creating nonsense jobs
Do the container logs show anything interesting
now trying restartint nas but immich wont do it, its shutting down now for like 30+ min
in container log theres no errors
but in system log there are out of memory events
have 6gb
now after few hours it is 1m less, weird
Why do you have 25 active jobs btw, I'm pretty sure that's not the default
its not, but its faster, isnt it?
is it problem?
Each job uses at least one cpu core
Do you have any symlinks
thx for the info about jobs, will reset it
i dont think im using symlinks, any way to check it?
It's not faster at all to overcrowd your system with jobs like that, the defaults are actually already pretty intense
Was this the latest version? I remember a bug that duped jobs not too long ago
yes, have latest version
now i see this
starting single jobs is okay?
what about the failed thumbs, do i have to restart the job?
missing or all?
Missing would be best
hi, so immich was running fine for some weeks, made update to latest 1.121 and was fine. today synology went out of memory (it happens time to time because of immich) and after hard restart, i see this
i have like 173k images, not 3m+
im really lost now
Did you add your library as external library or something
yes it like external library from beginning
Make a #help-desk-support and post your compose and env files
create a post right?
@Zeus where do you think we are 😛
Could you show us this page for your instance? https://my.immich.app/admin/library-management
Oh lolol
im connected via vpn, so not sure how i could do that
With a screenshot like any other time?
it's just your.url/admin/library-management
And the paths it uses?
Since all your pictures are in the external libary I'd recommend starting fresh, definitely NOT mess with the job settings and try again
It's either somehow nested
Or your settings are just way out of wack
not messing with job, everything set as default
what you mean start again?
i paused it, cleared it, resumed it and now it reads 0
anyway, not sure what happened, it consumed all ram and made my nas not reachable, had to hard reset it. is there any way to limit how much ram it can use?
hit refresh i went to 280k waiting and now counting towards 0
Well that sounds better 👀
yup, it was running for month+ without problems, really dunno what happened bcause i didnt changed anything
hello, yday i updated immich as usual, to 1.22.3. on 1.22.2 there was som transcoding jobs. now. on new 1.22.3 theres none. if i click ANY button on jobs, transcoding, thumbnails any and any button like missing all... it only add +1 to waiting but nothing happen. if i click 50times on that button, there will be 50 waiting
whats wrong
and from yday it didnt updated any of my backed up photos. im backing them via synology photos and immich is just reading them -ro and put it in immich
actually im checking backed up photos on synology photos and last good sync is on 12th, then nothing
is the library mounted properly?
same way as usually
it was working for more than month now
let me know how to check the mount and i will do it
i can see photos and open them, on web or phone
Well
docker compose logs might show something
That doesn't look like
docker compose logs to meok, its log from docker from synology. how to get log we need
I don't know, I don't run docker on synology 👀
can you help me how to get logs we are looking for?
Seems like no workers are being generated, I'm not sure where these reside
Is there enough space to pull the images?
yes, space is no problem
IMMICH_WORKERS_INCLUDE: 'api'
could this be it? tried to offload transcoding to my notebook but with no luck
There are more workers than that
maybe use the normal compose
compose is stock from this morning, but same results
Are you sure? Because it looks like the project fails to build
workers also has
microservices btw, which seems to be what you are missingim pretty sure, downloaded from web and just changed my external gallery
only env had that api line
Mine just doesn't have that env var at all, so if you customize you better read it well 👀
but what are these errors
[Nest] 35 - 12/17/2024, 9:34:52 AM ERROR [Api:GlobalExceptionFilter~q9wrhnpf] Unknown error: Error: ENOENT: no such file or directory, access 'upload/encoded-video/9c7c01df-0d4b-49f8-82b8-77fa73022653/53/a4/53a45cbd-2ba4-40e3-8110-d22ef6a5d675.mp4'
You queue a file, it can't process it, it can't do the followup on the created file because it was never created
Great, how to get rid of it? 🙂
have a microservices worker? 👀
tried to get one working, but with no luck. now stock on nas without external worker
so now env and compose stock, rebuilded and buttons on jobs are working and waiting etc looks okay now
but still lots of these errors
but looking at timestamp these are old errors right?
Yeah I guess so
I don't know how long ado you restarted it all 😛
10m
any way to clear that log or leave it as is
just leave it
ok, so they are actual error, timestamp on server is 1h offset
so transcoding number is going down fast but ist not transcoding anything
why it not fall back to SW, why it stil trying do hw encoding even when the switch is off?
selected disable and it works okay now, cpu load to max and log looks ok
what about missed transcoded videos now?
wait until it's done and select missing
why you didnt tell me that fallback isnt working 🙂 will you send it to developers to fix it?
If I knew I would tell you of course
🙂
when the log is saying it transcoding bc92dfa7-3c3a-4fd6-81d4-4d2f17baa599 file, how can i find the orignal file from my library which is presented with this bc92dfa7-3c3a-4fd6-81d4-4d2f17baa599 ?
https://my.immich.app/photos/bc92dfa7-3c3a-4fd6-81d4-4d2f17baa599 should have the details
nice trick, works, thx
ok, uff, so works okay. now, you have experience how to offload transcoding to external pc?
i have it running on ntb, but with no luck how to connect these two machines
I don't think there is any guide on offloading transcoding I'm afraid
I don't do it myself either
https://github.com/immich-app/immich/discussions/14142 @Stepe here's someone that made a guide