Immich•2y ago

CLI bulk upload only seems to cover half the uploads.

Hi all, As of recently I wanted to add around 40k assets to immich. I'm currently running immich via docker compose with the default compose and .env file. This all works without issue. I'm adding the assets from google drive which I have mounted by making use of rclone. I'm using the following command to upload the assets:

docker run --network hypnosnet -it --rm -v "$(pwd):/import" ghcr.io/immich-app/immich-cli:latest upload --key API_KEY_HERE--server http://immich-server:3001 --recursive --album

docker run --network hypnosnet -it --rm -v "$(pwd):/import" ghcr.io/immich-app/immich-cli:latest upload --key API_KEY_HERE--server http://immich-server:3001 --recursive --album

After running the command 20k assets have been discovered: https://i.imgur.com/sEB1cXv.png When I ran the command again, 99 additional assets were found making me believe it is not truly uploading every one to immich. The total upload size is 55.2GB with around 475 different albums, I know there are no duplicates. The total size on Gdrive is 95GB, meaning around 40GB is not uploaded. Help is greatly appreciated, as I don't know what is going on here.

Imgur

4 Replies

QuafleyOP•2y ago

I did noticed a lot of files sharing similar file names e.g., photo book, photo book (1) Reason it is on gdrive is because someone shared their photos with me and I have a rclone mount

Alex Tran•2y ago

Maybe there are different file type on your Gdrive that is not currently supported by Immich?

QuafleyOP•2y ago

Perhaps yeah, and my command also looks fine? I was worried recursive wasn't going deep enough So just to be clear, there is no such thing as a maximum upload (abreast not for this amount), the command is correct. I'll have a look what file extentions I can find Hi @Alex, I did some more digging and these files are to my knowledge not supported, but do recide within the drive.

lnk 3
db 94
xls 1
AAE 6
ithmb 20175 <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< These are unknown to me
docx 2
tif 2
doc 1
tmp 9
pdf 14
msg 2
onetoc2 150
oxps 1
zdx 2

lnk 3
db 94
xls 1
AAE 6
ithmb 20175 <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< These are unknown to me
docx 2
tif 2
doc 1
tmp 9
pdf 14
msg 2
onetoc2 150
oxps 1
zdx 2

it is the ithmb that got it to 40k, gonna search around a bit what this file extention is. a thumbnail images, interesting. I'll let him know he might've backed up the wrong pictures. I don't know if you're familiar with the workings?

Alex Tran•2y ago

What do you mean with the workings?

Gaming

Programming

CLI bulk upload only seems to cover half the uploads.

Did you find this page helpful?