Immich•6mo ago

Reprocess specific transcoded videos?

Hello found a album where all of the videos do not want to play in the web ui (something about mime support). It's odd as it's the same phone I've used for 1000s of other videos but this one day of videos does not work. On PC I tried 3 browsers and same

Anyhow I see in we ui a way to progress the video again, awesome. However doing this did not change any results.

I guess I was wondering 2 things.

If I find the matching file in encodedvideo folder and just delete it, will immich recreate it for me? (I guess if the answer is yes I am curious how to identify the name and path to the specific file in encodedvideo as well)
Similarly, I may want to just delete all the encodedvideo folder and start over. Would this work! My thought here is that deleting and starting over is more concrete to see the files were regenerated, vs trusting the reprocess thing actually doing something. I also separately have issues where that folder takes up space and never let go it's its space after deleting (separate issue I posted a couple of weeks backl

Thanks

Immich•7/9/25, 10:37 AM

:wave: Hey @RoachForLife,

Thanks for reaching out to us. Please carefully read this message and follow the recommended actions. This will help us be more effective in our support effort and leave more time for building Immich :immich:.

References

Container Logs:
```
docker compose logs
```
```
docker compose logs
```
docs
Container Status:
```
docker ps -a
```
```
docker ps -a
```
docs
Reverse Proxy: https://immich.app/docs/administration/reverse-proxy
Code Formatting https://support.discord.com/hc/en-us/articles/210298617-Markdown-Text-101-Chat-Formatting-Bold-Italic-Underline#h_01GY0DAKGXDEHE263BCAYEGFJA

Immich•7/9/25, 10:37 AM

Checklist

I have...

:ballot_box_with_check: verified I'm on the latest release(note that mobile app releases may take some time).
:ballot_box_with_check: read applicable release notes.
:ballot_box_with_check: reviewed the FAQs for known issues.
:ballot_box_with_check: reviewed Github for known issues.
:ballot_box_with_check: tried accessing Immich via local ip (without a custom reverse proxy).
:ballot_box_with_check: uploaded the relevant information (see below).
:ballot_box_with_check: tried an incognito window, disabled extensions, cleared mobile app cache, logged out and back in, different browsers, etc. as applicable

(an item can be marked as "complete" by reacting with the appropriate number)

Information

In order to be able to effectively help you, we need you to provide clear information to show what the problem is. The exact details needed vary per case, but here is a list of things to consider:

Your docker-compose.yml and .env files.
Logs from all the containers and their status (see above).
All the troubleshooting steps you've tried so far.
Any recent changes you've made to Immich or your system.
Details about your system (both software/OS and hardware).
Details about your storage (filesystems, type of disks, output of commands like
```
fdisk -l
```
```
fdisk -l
```
and
```
df -h
```
```
df -h
```
).
The version of the Immich server, mobile app, and other relevant pieces.
Any other information that you think might be relevant.

Please paste files and logs with proper code formatting, and especially avoid blurry screenshots.
Without the right information we can't work out what the problem is. Help us help you ;)

If this ticket can be closed you can use the

/close

/close

command, and re-open it later if needed.

RoachForLifeOP•7/9/25, 10:38 AM

Raw files on external library on the Nas, immich (dB and encodedvideo) sits on same Nas but ssd drive

Using 1.35 immich

IImmich ## Checklist I have... 1. :ballot_box_with_check: verified I'm on the latest rel...

ImmichAPP•7/9/25, 10:39 AM

Successfully submitted, a tag has been added to inform contributors. :white_check_mark:

RoachForLifeOP•7/11/25, 10:13 AM

Curious if any of the mods could help on this one, thanks

schuhbacca•7/11/25, 12:03 PM

1) No I don't believe so. It will just error when attempting to play the transcode as it won't be able to find it. (You should not manually touch anything in the upload location)
2) To minimize touching the folder directly. You can turn the trnascode policy to "Don't transcode" then run the "Transcode All" Job. This should delete all items in the encoded-vidoes folder. Then you can double check and see if there's extra stuff in the folder

RoachForLifeOP•7/14/25, 2:09 PM

Ok thanks I will give #2 a shot later this week. Thanks

RoachForLifeOP•7/24/25, 9:45 PM

@schuhbacca So I did just what you said finally and results were a bit shocking but seem to support my concern. Top image is before setting to Do not transcode, bottom is after processing

RoachForLifeOP•7/24/25, 9:46 PM

Why would anything still remain in the encoded-video folder at all? There are still 113gig of videos in there

schuhbacca•7/25/25, 12:41 PM

Not sure, what I said should remove all encoded videos that immich is tracking. Can you see what's in that folder?

RoachForLifeOP•7/25/25, 2:54 PM

It ended up being videos of course. Should I try to cross reference the id back to immich, or maybe to the DB?

RoachForLifeOP•7/25/25, 2:54 PM

I was going to reprocess everything soon so if this is something I should do as a test I probably need to do it soon

schuhbacca•7/25/25, 2:54 PM

Yeah I would. Or look for errors in server log when running the transcode job with none set

RoachForLifeOP•7/25/25, 2:55 PM

Sorry but where do I get to the server log? Normally I just check dockge but not sure it will have the history from yesterday but ill check

schuhbacca•7/25/25, 2:56 PM

terminal can just run

docker logs immich_server

docker logs immich_server

or whatever your server container name is

RoachForLifeOP•7/25/25, 2:56 PM

ok cool let me do that.

RoachForLifeOP•7/25/25, 2:58 PM

looks like i cant go fair enough back for it all (some is cut off the screen). Is there a way to have it save this to a file maybe?

RoachForLifeOP•7/25/25, 2:59 PM

Here is a portion of it at least

logimmich.txt97.32KB

schuhbacca•7/25/25, 3:00 PM

That all looks fine according to the logs (At least related to video transcoding deletion). You can try and query the db to see if any of the transcode video columns are not nulled out

schuhbacca•7/25/25, 3:01 PM

Have you ever re-installed or anything like that?

RoachForLifeOP•7/25/25, 3:52 PM

@schuhbacca Reinstalled, no, just standard updates thru the months. I am unsure how to query the db. Is there a set of instructions somewhere on this?

schuhbacca•7/25/25, 3:53 PM

https://immich.app/docs/guides/database-queries/

RoachForLifeOP•7/25/25, 4:23 PM

ok thanks. Regarding the query should I be looking up specific files or can I run a query to look up the null in the transcoded video column specifically? Or maybe do this? SELECT * FROM "assets" WHERE "assets"."type" = 'VIDEO';

RoachForLifeOP•7/25/25, 4:26 PM

RoachForLifeOP•7/25/25, 4:27 PM

I used docker exec -it immich_postgres psql --dbname=immich --username=postgres, to get into it, which I believe is right. Doesnt seem to find the assets table

RoachForLifeOP•7/26/25, 5:44 PM

It seems the table is asset not plural. Anyhow I did run this. Cant seem to copy all of it, is it possible to export to a file?

RoachForLifeOP•7/26/25, 5:51 PM

Anyhow heres a small snippet

Sergey Katsubo•7/29/25, 1:15 PM

the table is asset not plural.

You correctly spotted it. Plural to singular was changed in 1.136 and not yet reflected in the docs.

Sergey Katsubo•7/29/25, 1:21 PM

Thanks for the asset snippet!

```
encodedVideoPath
```
```
encodedVideoPath
```
is null, this is good / expected as we don't transcode anymore.
But there are assets with
```
originalPath
```
```
originalPath
```
containing
```
upload/encoded-video/<...>.mp4
```
```
upload/encoded-video/<...>.mp4
```
which is rather unexpected. Encoded-video should not appear in originalPath. It looks like transcoded video files were actually added into Immich as original videos, hmm

RoachForLifeOP•7/31/25, 9:25 PM

@Sergey Katsubo Thanks. I do have the setting to NOT encode if a mp4 already so unsure how it would get in there. If I use this setting, should I expect zero .mp4s in the encodedvideo folder?

Sergey Katsubo•7/31/25, 10:11 PM

Let's split concerns into 2 topics.

Encoded or not encoded videos / mp4.
The fact that ".../encoded-video/...mp4" appear as original assets. (This is troubling me)

Sergey Katsubo•7/31/25, 10:12 PM

For (1) could you grab stats from the database: count of videos

by extension

and whether they have been encoded or not (if they have non-empty encodedVideoPath)

SELECT 
  SUBSTRING("originalFileName" FROM '\.([^\.]+)$') AS ext,
  CASE 
      WHEN "encodedVideoPath" IS NULL 
      THEN NULL
      ELSE 'encoded'
  END AS encoded,
  COUNT(*) AS count
FROM asset
WHERE type = 'VIDEO'
GROUP BY 1,2 ORDER BY 1,2;

SELECT 
  SUBSTRING("originalFileName" FROM '\.([^\.]+)$') AS ext,
  CASE 
      WHEN "encodedVideoPath" IS NULL 
      THEN NULL
      ELSE 'encoded'
  END AS encoded,
  COUNT(*) AS count
FROM asset
WHERE type = 'VIDEO'
GROUP BY 1,2 ORDER BY 1,2;

RoachForLifeOP•8/2/25, 9:31 PM

Thanks Sergey. I had moved on and deleted everything and reprocessed (see this post as it hasnt gotten any traction but is also concerning and related - https://www.reddit.com/r/immich/comments/1m8hfib/my_journey_into_immich_not_recovering_itself/ ) but I did back it up in proxmox. I will make a point of creating a new lxc restore of everything and run the sql on it and post back here. Appreciate it!

From the immich community on Reddit

Explore this post and more from the immich community

RoachForLifeOP•8/2/25, 9:35 PM

Regarding backups I have the following backups, let me know which is best. I assume the one after I turned off transcoding and it removed most items but still a bunch remained in the encodedvideo folder?

Prior to any edits
After setting transcoding to OFF and it deleted nearly half of the files in encodedvideos folder

jrasm91•8/3/25, 12:00 AM

The files with -MP suffix are extracted motion videos from Android motion photos and should not be deleted.

RoachForLifeOP•8/3/25, 5:20 PM

@Sergey Katsubo Ok took a bit but I was able to load a new proxmox ct with the state right after I turned transcoding to OFF and it deleted a bunch, but not all, of the videos. And ran your statement. See attached

Jjrasm91 The files with -MP suffix are extracted motion videos from Android motion photos...

RoachForLifeOP•8/3/25, 5:24 PM

Thanks, this is helpful. On my other machine (where I reprocessed everything, not the one I just told sergey about), it seems I have 13k motion photos videos with the -mp (40gig). I had put in a FR a month ago for the option to have Immich not process these. I obviously have these 13k where I actually would prefer the space back, and the only way I know to fix them is on my phone, meaning Id have to transfer them to and from my phone to strip the video portion. Having immich just not process the video would be nearly as good as I at least wouldnt have the extra video.

It's actually kinda crazy that my entire immich library folder is 183gb and 40gb of that are motion videos I dont want

RRoachForLife Thanks, this is helpful. On my other machine (where I reprocessed everything, no...

jrasm91•8/3/25, 5:46 PM

We can probably add a system config option for that.

Jjrasm91 We can probably add a system config option for that.

RoachForLifeOP•8/3/25, 6:02 PM

Thank you for considering that! I didnt realize it was nearly 1/4 of all of my server space just in motion videos so that would be great

RRoachForLife @Sergey Katsubo Ok took a bit but I was able to load a new proxmox ct with the ...

RoachForLifeOP•8/4/25, 10:39 PM

@Sergey Katsubo Hola. Just curious if that output helped? Thanks

Sergey Katsubo•8/5/25, 5:41 AM

Hey.
Yes, it has become clearer now, thanks to the SQL statement output + your comments + Jason's note about MP being extracted motion videos.

So it turned out that both my prev questions are connected, not independent:

Encoded or not encoded videos / mp4.
The fact that ".../encoded-video/...mp4" appear as original assets. (This is troubling me)

The short answer: this is the way how Immich handles MP (motion photos). It is expected. If I got it right:

Why do mp4/mov files appear in
```
encoded-video
```
```
encoded-video
```
despite Video Transcoding is disabled? (Intuitive expectation: encoded-video should be empty). Answer: because Immich extracted them from MPs and put there. This processing of MPs happens independently of Transcoding policy.
Why do mp4/mov files in
```
encoded-video
```
```
encoded-video
```
have "original" asset mark? (Intuitive expectation: encoded-videos are not originals. They are transcoded versions of actual original assets living in other locations, internal or external libraries). Answer: they appear as "original" assets because they were extracted from MPs and now live a separate live as "originals". This motion videos from MPs live in
```
encoded-video
```
```
encoded-video
```
because this is how it's implemented.

@jrasm91 Is this a correct explanation?

Sergey Katsubo•8/5/25, 6:05 AM

We can add an extra dimension - MP or not - to the stats from

asset

asset

table in DB:

SELECT 
    LOWER(SUBSTRING("originalPath" FROM '\.([^\.]+)$')) AS ext,
    CASE 
        WHEN "encodedVideoPath" IS NULL 
        THEN NULL
        ELSE 'encoded'
    END AS encoded,
    CASE
        WHEN "originalPath" LIKE '%-MP.%'
        THEN 'MP'
        ELSE NULL
    END AS mp,
    COUNT(*) AS count
FROM asset
WHERE type = 'VIDEO'
GROUP BY 1, 2, 3 ORDER BY 1, 2, 3;

SELECT 
    LOWER(SUBSTRING("originalPath" FROM '\.([^\.]+)$')) AS ext,
    CASE 
        WHEN "encodedVideoPath" IS NULL 
        THEN NULL
        ELSE 'encoded'
    END AS encoded,
    CASE
        WHEN "originalPath" LIKE '%-MP.%'
        THEN 'MP'
        ELSE NULL
    END AS mp,
    COUNT(*) AS count
FROM asset
WHERE type = 'VIDEO'
GROUP BY 1, 2, 3 ORDER BY 1, 2, 3;

RoachForLifeOP•8/5/25, 11:28 AM

RoachForLifeOP•8/5/25, 11:32 AM

@Sergey Katsubo Here is the latest sql query. I am not certain this all is making sense tho. So in my live production Immich which has a lot more data on it (reprocessed everything after turning transcoding off). There I have 40gb of Motion Photo videos (with -mp). On this other box we are using, right when I disabled transcoding, it has about 113gb of space being used in the encodedvideo folder. That leaves a difference of about 73gb of space that is not a motion photo video and should not exist.

I am re-running to see how many MP files exist right now in the previous state system I am working on with you and will report back in 10min when it goes through its check

RoachForLifeOP•8/5/25, 11:34 AM

Can you confirm that if transcoding is OFF, that, less the MP files, it should clear out all of the videos? The system does have this setting on currently

RoachForLifeOP•8/5/25, 11:35 AM

So if something is a h.264, does it just use the file in the external library or does it make its own copy for the encodedvideo folder?

RoachForLifeOP•8/5/25, 11:38 AM

I suppose if the answer to that is, it makes its own copy (which feels redundant to not just reference the same file over on my external library) but anyhow, then would unchecking H.264 and setting to DONT TRANSCODE, would it then have nothing (zero) in the encoded video folder?

Ultimately, reprocessing the exact same data has produced an encodedvideo folder that is 30-40gb smaller so something extra was definitely lingering in there

SSergey Katsubo Hey. Yes, it has become clearer now, thanks to the SQL statement output + your c...

jrasm91•8/5/25, 12:58 PM

Yes, we need the motion video portion of the live photo to be it's own asset with an original path, but that original asset is actually generated from the android motion jpeg. So it's an original path, but generated. So we decided to put it in encoded-videos, to indicate that it is generated.

RRoachForLife Can you confirm that if transcoding is OFF, that, less the MP files, it should c...

Sergey Katsubo•8/5/25, 1:08 PM

https://github.com/immich-app/immich/blob/ce2ea989265e878eedf4aaf1e1b73802b1c53c21/server/src/services/media.service.ts#L492-L499

It removes the transcode when TranscodePolicy.Disabled
It writes a log message at default LOG level, so it will be visible in the Immich container logs.

Did you run 1 pass of reprocessing (Transcode Videos job) or 2 passes and the second pass freed additional space?

SSergey Katsubo https://github.com/immich-app/immich/blob/ce2ea989265e878eedf4aaf1e1b73802b1c53c...

Immich•8/5/25, 1:08 PM

    if (target === TranscodeTarget.None && !this.isRemuxRequired(ffmpeg, format)) {
      if (asset.encodedVideoPath) {
        this.logger.log(\`Transcoded video exists for asset ${asset.id}, but is no longer required. Deleting...\`);
        await this.jobRepository.queue({ name: JobName.FileDelete, data: { files: [asset.encodedVideoPath] } });
        await this.assetRepository.update({ id: asset.id, encodedVideoPath: null });
      } else {
        this.logger.verbose(\`Asset ${asset.id} does not require transcoding based on current policy, skipping\`);
      }

    if (target === TranscodeTarget.None && !this.isRemuxRequired(ffmpeg, format)) {
      if (asset.encodedVideoPath) {
        this.logger.log(\`Transcoded video exists for asset ${asset.id}, but is no longer required. Deleting...\`);
        await this.jobRepository.queue({ name: JobName.FileDelete, data: { files: [asset.encodedVideoPath] } });
        await this.assetRepository.update({ id: asset.id, encodedVideoPath: null });
      } else {
        this.logger.verbose(\`Asset ${asset.id} does not require transcoding based on current policy, skipping\`);
      }

Reprocess specific transcoded videos?

References

Checklist

Information

Similar Threads

Similar Threads

Similar Threads

References

Checklist

Information