Immich•2y ago

CLI does not recognise already uploaded photos

I was using the CLI because I was told that it does the same checksums as the app, and I wanted to speed up the slow app upload. I made a backup of all my photos, and started uploading them all with the cli. At 55% it failed, and now if I start it again it's trying to upload again the same amount of pictures. Why is this? Why is it not performing the required checksums to ensure it does not upload the same thing twice?

immich upload --key api-key --server https://foto.url/api --recursive Camera 
Server status: OK
Checking credentials
Login status: OK
Successful authentication for user
Indexing local assets
Indexing complete, found 3761 local assets
Comparing local assets with those on the Immich instance
A total of 3761 assets will be uploaded to the server
Do you want to start upload now? (y/n) y
Start uploading...
Upload Progress | ████████████████████████░░░░░░░░░░░░░░░░ | 59% || 2247/3761 || Current file [/Users/danielo/2023-note8-backup/Camera/20220625_110509.mp4]node:events:490
      throw er; // Unhandled 'error' event
      ^
Error: write EPIPE
    at WriteWrap.onWriteComplete [as oncomplete] (node:internal/stream_base_commons:94:16)
Emitted 'error' event on TLSSocket instance at:
    at emitErrorNT (node:internal/streams/destroy:151:8)
    at emitErrorCloseNT (node:internal/streams/destroy:116:3)
    at process.processTicksAndRejections (node:internal/process/task_queues:82:21) {
  errno: -32,
  code: 'EPIPE',
  syscall: 'write'
}

Node.js v19.8.1

immich upload --key key --server https://foto.url/api --recursive Camera
Checking connectivity with Immich instance
Server status: OK
Checking credentials
Login status: OK
Successful authentication for user
Indexing local assets
Indexing complete, found 3761 local assets
Comparing local assets with those on the Immich instance
A total of 3718 assets will be uploaded to the server
Do you want to start upload now? (y/n) y
Start uploading
Upload Progress | 4/3761 || Current file

immich upload --key api-key --server https://foto.url/api --recursive Camera 
Server status: OK
Checking credentials
Login status: OK
Successful authentication for user
Indexing local assets
Indexing complete, found 3761 local assets
Comparing local assets with those on the Immich instance
A total of 3761 assets will be uploaded to the server
Do you want to start upload now? (y/n) y
Start uploading...
Upload Progress | ████████████████████████░░░░░░░░░░░░░░░░ | 59% || 2247/3761 || Current file [/Users/danielo/2023-note8-backup/Camera/20220625_110509.mp4]node:events:490
      throw er; // Unhandled 'error' event
      ^
Error: write EPIPE
    at WriteWrap.onWriteComplete [as oncomplete] (node:internal/stream_base_commons:94:16)
Emitted 'error' event on TLSSocket instance at:
    at emitErrorNT (node:internal/streams/destroy:151:8)
    at emitErrorCloseNT (node:internal/streams/destroy:116:3)
    at process.processTicksAndRejections (node:internal/process/task_queues:82:21) {
  errno: -32,
  code: 'EPIPE',
  syscall: 'write'
}

Node.js v19.8.1

immich upload --key key --server https://foto.url/api --recursive Camera
Checking connectivity with Immich instance
Server status: OK
Checking credentials
Login status: OK
Successful authentication for user
Indexing local assets
Indexing complete, found 3761 local assets
Comparing local assets with those on the Immich instance
A total of 3718 assets will be uploaded to the server
Do you want to start upload now? (y/n) y
Start uploading
Upload Progress | 4/3761 || Current file

12 Replies

Alex Tran•2y ago

Do you know if the previous 2247 files are on the server?

danielo515OP•2y ago

It's hard to check by hand. But why would the CLI report a progress of 59% if not?

Alex Tran•2y ago

I am not sure, trying to see where the problem is. Your server looks to be choked hence the timeout

danielo515OP•2y ago

i tried searching some file name, but that doesn't work Is any other way to compare

Alex Tran•2y ago

Try to reupload them again and monitor you server usage Looks like from the initial@upload there was only a shy 50 aseets that get to the server

danielo515OP•2y ago

Is it trying to process them and then upload or something? Because it's not normal that it gets up to 59% and not upload a single thing I tried again, and last time I checked it was 70% already. I can't see how much it uploaded because the amount of errors and the size of each error is far beyond my console scrollback Third attempt: A total of 3625 assets will be uploaded to the server However the progress says 0% || 3/3761

danielo515OP•2y ago

While uploading my memmory usagge goes quite high:

Alex Tran•2y ago

Any log on the server? Ram can range from 4-6GB during upload

danielo515OP•2y ago

do you mean from the containers? from thhe system?

Alex Tran•2y ago

It doesn’t matter, RAM is RAM right? The container will use how much RAM you allocate for it

danielo515OP•2y ago

yes, but what are we looking for in the logs?

Alex Tran•2y ago

Can you post the log for the server and the microservices container?

Gaming

Programming

CLI does not recognise already uploaded photos

Did you find this page helpful?