Help checking my volume setup
trying to set custom storage locations for thumbs, uploads, profile, library, and encoded-video and I'm seeing some errors
Will try and elaborate in comments since the putting errors/compose/env in the post makes it too long.
4 Replies
1st, the thumbnail errors - doesn't happen every time but I do see in the logs:
then random TypeErrors:
my
my yml - part 1:
yml part 2:
as far as what I can observe - it seems like thumb generation is working. Transcoding is not. This was a previously known good config for GPU transcoding before I started tweaking with the volume paths.
lol, ok transcoding wasn't working because i forgot to enable it again in settings. And everything else seems to be working ok on mobile and webapp... are the errors above benign? did i do the volume settings correctly?
logs are still full of that TypeError posted above - can't really figure out what that is impacting tho
immich_server | getAssetThumbnail
immich_server | [Nest] 7 - 09/17/2023, 6:30:25 PM WARN [AssetService] WebP thumbnail requested but not found for asset b69e2da2-def4-4869-a79a-44f4f7c6922b, falling back to JPEG
immich_server | [Nest] 7 - 09/17/2023, 6:30:25 PM ERROR [AssetService] Cannot create read stream for asset b69e2da2-def4-4869-a79a-44f4f7c6922b
immich_server | getAssetThumbnail
immich_microservices | [Nest] 7 - 09/17/2023, 2:30:25 PM LOG [MediaService] Successfully generated WEBP image thumbnail for asset 8183e6aa-296d-40b8-a309-2ef0c24f9899
immich_microservices | [Nest] 7 - 09/17/2023, 2:30:28 PM LOG [MediaService] Successfully generated WEBP image thumbnail for asset d53c342e-2218-4384-82d6-35aae1601f78
immich_microservices | [Nest] 7 - 09/17/2023, 2:30:29 PM LOG [MediaService] Successfully generated WEBP image thumbnail for asset 6ee4fa30-57dc-4f53-88d7-fc93bf46079e
immich_server | getAssetThumbnail
immich_server | [Nest] 7 - 09/17/2023, 6:30:25 PM WARN [AssetService] WebP thumbnail requested but not found for asset b69e2da2-def4-4869-a79a-44f4f7c6922b, falling back to JPEG
immich_server | [Nest] 7 - 09/17/2023, 6:30:25 PM ERROR [AssetService] Cannot create read stream for asset b69e2da2-def4-4869-a79a-44f4f7c6922b
immich_server | getAssetThumbnail
immich_microservices | [Nest] 7 - 09/17/2023, 2:30:25 PM LOG [MediaService] Successfully generated WEBP image thumbnail for asset 8183e6aa-296d-40b8-a309-2ef0c24f9899
immich_microservices | [Nest] 7 - 09/17/2023, 2:30:28 PM LOG [MediaService] Successfully generated WEBP image thumbnail for asset d53c342e-2218-4384-82d6-35aae1601f78
immich_microservices | [Nest] 7 - 09/17/2023, 2:30:29 PM LOG [MediaService] Successfully generated WEBP image thumbnail for asset 6ee4fa30-57dc-4f53-88d7-fc93bf46079e
immich_microservices | [Nest] 7 - 09/17/2023, 2:26:59 PM LOG [MediaService] Successfully generated WEBP image thumbnail for asset 2a43b76b-d7fb-495f-b003-c905191ff9e7
immich_microservices | [Nest] 7 - 09/17/2023, 2:26:59 PM ERROR [JobService] Unable to run job handler: TypeError: fetch failed
immich_microservices | [Nest] 7 - 09/17/2023, 2:26:59 PM ERROR [JobService] TypeError: fetch failed
immich_microservices | at Object.fetch (node:internal/deps/undici/undici:11576:11)
immich_microservices | at async MachineLearningRepository.post (/usr/src/app/dist/infra/repositories/machine-learning.repository.js:27:21)
immich_microservices | at async SmartInfoService.handleClassifyImage (/usr/src/app/dist/domain/smart-info/smart-info.service.js:77:22)
immich_microservices | at async /usr/src/app/dist/domain/job/job.service.js:105:37
immich_microservices | at async Worker.processJob (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:346:28)
immich_microservices | at async Worker.retryIfFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:531:24)
immich_microservices | [Nest] 7 - 09/17/2023, 2:26:59 PM ERROR [JobService] Object:
immich_microservices | {
immich_microservices | "id": "3a111ba1-4990-4195-a85c-1d028966923f",
immich_microservices | "source": "upload"
immich_microservices | }
immich_microservices |
immich_microservices | [Nest] 7 - 09/17/2023, 2:26:59 PM LOG [MediaService] Successfully generated WEBP image thumbnail for asset 45d25d9a-35ae-4caa-88c3-6d54355d6a7b
immich_microservices | [Nest] 7 - 09/17/2023, 2:26:59 PM LOG [MediaService] Successfully generated WEBP image thumbnail for asset 3a111ba1-4990-4195-a85c-1d028966923f
immich_microservices | [Nest] 7 - 09/17/2023, 2:26:59 PM LOG [MediaService] Successfully generated WEBP image thumbnail for asset 2a43b76b-d7fb-495f-b003-c905191ff9e7
immich_microservices | [Nest] 7 - 09/17/2023, 2:26:59 PM ERROR [JobService] Unable to run job handler: TypeError: fetch failed
immich_microservices | [Nest] 7 - 09/17/2023, 2:26:59 PM ERROR [JobService] TypeError: fetch failed
immich_microservices | at Object.fetch (node:internal/deps/undici/undici:11576:11)
immich_microservices | at async MachineLearningRepository.post (/usr/src/app/dist/infra/repositories/machine-learning.repository.js:27:21)
immich_microservices | at async SmartInfoService.handleClassifyImage (/usr/src/app/dist/domain/smart-info/smart-info.service.js:77:22)
immich_microservices | at async /usr/src/app/dist/domain/job/job.service.js:105:37
immich_microservices | at async Worker.processJob (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:346:28)
immich_microservices | at async Worker.retryIfFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:531:24)
immich_microservices | [Nest] 7 - 09/17/2023, 2:26:59 PM ERROR [JobService] Object:
immich_microservices | {
immich_microservices | "id": "3a111ba1-4990-4195-a85c-1d028966923f",
immich_microservices | "source": "upload"
immich_microservices | }
immich_microservices |
immich_microservices | [Nest] 7 - 09/17/2023, 2:26:59 PM LOG [MediaService] Successfully generated WEBP image thumbnail for asset 45d25d9a-35ae-4caa-88c3-6d54355d6a7b
immich_microservices | [Nest] 7 - 09/17/2023, 2:26:59 PM LOG [MediaService] Successfully generated WEBP image thumbnail for asset 3a111ba1-4990-4195-a85c-1d028966923f
.env: # You can find documentation for all the supported env variables at https://immich.app/docs/install/environment-variables
###################################################################################
# Upload And Other File Locations
#
# This is the location where uploaded files are stored.
###################################################################################
LIBRARY_LOCATION=/mnt/user/Photos
THUMBS_LOCATION=/mnt/nextcache/Immich/thumbs
ENCODED_VIDEO_LOCATION=/mnt/nextcache/Immich/encoded-video
UPLOAD_LOCATION=/mnt/user/nextcache/upload
PROFILE_PICTURE_LOCATION=/mnt/user/nextcache/profile
# The Immich version to use. You can pin this to a specific version like "v1.71.0"
IMMICH_VERSION=release
# Connection secrets for postgres and typesense. You should change these to random passwords
TYPESENSE_API_KEY=NOPE
DB_PASSWORD=immich
# The values below this line do not need to be changed
###################################################################################
DB_HOSTNAME=192.168.x.y
DB_USERNAME=immich
DB_DATABASE_NAME=immich3
REDIS_HOSTNAME=immich_redis
# You can find documentation for all the supported env variables at https://immich.app/docs/install/environment-variables
###################################################################################
# Upload And Other File Locations
#
# This is the location where uploaded files are stored.
###################################################################################
LIBRARY_LOCATION=/mnt/user/Photos
THUMBS_LOCATION=/mnt/nextcache/Immich/thumbs
ENCODED_VIDEO_LOCATION=/mnt/nextcache/Immich/encoded-video
UPLOAD_LOCATION=/mnt/user/nextcache/upload
PROFILE_PICTURE_LOCATION=/mnt/user/nextcache/profile
# The Immich version to use. You can pin this to a specific version like "v1.71.0"
IMMICH_VERSION=release
# Connection secrets for postgres and typesense. You should change these to random passwords
TYPESENSE_API_KEY=NOPE
DB_PASSWORD=immich
# The values below this line do not need to be changed
###################################################################################
DB_HOSTNAME=192.168.x.y
DB_USERNAME=immich
DB_DATABASE_NAME=immich3
REDIS_HOSTNAME=immich_redis
version: "2.4"
#version: "3.8"
services:
immich-server:
container_name: immich_server
image: ghcr.io/immich-app/immich-server:${IMMICH_VERSION:-release}
command: [ "start.sh", "immich" ]
volumes:
- ${LIBRARY_LOCATION}:/usr/src/app/upload/library
- ${UPLOAD_LOCATION}:/usr/src/app/upload/upload
- ${THUMBS_LOCATION}:/usr/src/app/upload/thumbs
- ${ENCODED_VIDEO_LOCATION}:/usr/src/app/upload/encoded-video
- ${PROFILE_PICTURE_LOCATION}:/usr/src/app/upload/profile
env_file:
- .env
depends_on:
- redis
# - database
- typesense
restart: always
immich-microservices:
container_name: immich_microservices
# cpuset: "0,1,2,3,10,11,12,13"
cpus: 6
image: ghcr.io/immich-app/immich-server:${IMMICH_VERSION:-release}
extends:
file: hwaccel.yml
service: hwaccel
command: [ "start.sh", "microservices" ]
volumes:
- ${LIBRARY_LOCATION}:/usr/src/app/upload/library
- ${UPLOAD_LOCATION}:/usr/src/app/upload/upload
- ${THUMBS_LOCATION}:/usr/src/app/upload/thumbs
- ${ENCODED_VIDEO_LOCATION}:/usr/src/app/upload/encoded-video
- ${PROFILE_PICTURE_LOCATION}:/usr/src/app/upload/profile
env_file:
- .env
depends_on:
- redis
# - database
- typesense
restart: always
environment:
- TZ=America/New_York
version: "2.4"
#version: "3.8"
services:
immich-server:
container_name: immich_server
image: ghcr.io/immich-app/immich-server:${IMMICH_VERSION:-release}
command: [ "start.sh", "immich" ]
volumes:
- ${LIBRARY_LOCATION}:/usr/src/app/upload/library
- ${UPLOAD_LOCATION}:/usr/src/app/upload/upload
- ${THUMBS_LOCATION}:/usr/src/app/upload/thumbs
- ${ENCODED_VIDEO_LOCATION}:/usr/src/app/upload/encoded-video
- ${PROFILE_PICTURE_LOCATION}:/usr/src/app/upload/profile
env_file:
- .env
depends_on:
- redis
# - database
- typesense
restart: always
immich-microservices:
container_name: immich_microservices
# cpuset: "0,1,2,3,10,11,12,13"
cpus: 6
image: ghcr.io/immich-app/immich-server:${IMMICH_VERSION:-release}
extends:
file: hwaccel.yml
service: hwaccel
command: [ "start.sh", "microservices" ]
volumes:
- ${LIBRARY_LOCATION}:/usr/src/app/upload/library
- ${UPLOAD_LOCATION}:/usr/src/app/upload/upload
- ${THUMBS_LOCATION}:/usr/src/app/upload/thumbs
- ${ENCODED_VIDEO_LOCATION}:/usr/src/app/upload/encoded-video
- ${PROFILE_PICTURE_LOCATION}:/usr/src/app/upload/profile
env_file:
- .env
depends_on:
- redis
# - database
- typesense
restart: always
environment:
- TZ=America/New_York
immich-machine-learning:
container_name: immich_machine_learning
image: ghcr.io/immich-app/immich-machine-learning:${IMMICH_VERSION:-release}
volumes:
- model-cache:/cache
env_file:
- .env
restart: always
immich-web:
container_name: immich_web
image: ghcr.io/immich-app/immich-web:${IMMICH_VERSION:-release}
env_file:
- .env
restart: always
typesense:
container_name: immich_typesense
image: typesense/typesense:0.24.1@sha256:9bcff2b829f12074426ca044b56160ca9d777a0c488303469143dd9f8259d4dd
environment:
- TYPESENSE_API_KEY=${TYPESENSE_API_KEY}
- TYPESENSE_DATA_DIR=/data
# remove this to get debug messages
- GLOG_minloglevel=1
volumes:
- tsdata:/data
restart: always
redis:
container_name: immich_redis
image: redis:6.2-alpine@sha256:70a7a5b641117670beae0d80658430853896b5ef269ccf00d1827427e3263fa3
restart: always
immich-proxy:
container_name: immich_proxy
image: ghcr.io/immich-app/immich-proxy:${IMMICH_VERSION:-release}
environment:
- IMMICH_SERVER_URL
- IMMICH_WEB_URL
ports:
- 2283:8080
depends_on:
- immich-server
- immich-web
restart: always
volumes:
# pgdata:
model-cache:
tsdata:
immich-machine-learning:
container_name: immich_machine_learning
image: ghcr.io/immich-app/immich-machine-learning:${IMMICH_VERSION:-release}
volumes:
- model-cache:/cache
env_file:
- .env
restart: always
immich-web:
container_name: immich_web
image: ghcr.io/immich-app/immich-web:${IMMICH_VERSION:-release}
env_file:
- .env
restart: always
typesense:
container_name: immich_typesense
image: typesense/typesense:0.24.1@sha256:9bcff2b829f12074426ca044b56160ca9d777a0c488303469143dd9f8259d4dd
environment:
- TYPESENSE_API_KEY=${TYPESENSE_API_KEY}
- TYPESENSE_DATA_DIR=/data
# remove this to get debug messages
- GLOG_minloglevel=1
volumes:
- tsdata:/data
restart: always
redis:
container_name: immich_redis
image: redis:6.2-alpine@sha256:70a7a5b641117670beae0d80658430853896b5ef269ccf00d1827427e3263fa3
restart: always
immich-proxy:
container_name: immich_proxy
image: ghcr.io/immich-app/immich-proxy:${IMMICH_VERSION:-release}
environment:
- IMMICH_SERVER_URL
- IMMICH_WEB_URL
ports:
- 2283:8080
depends_on:
- immich-server
- immich-web
restart: always
volumes:
# pgdata:
model-cache:
tsdata:
what I'm really trying to figure out is why is the GPU utilization so low on my Gen9 Intel? Is the TypeError related?
The type errors look like something related to a network failure or machine learning being unavailable. Are you still seeing those issues?
last one was 2 days ago on 9/19 @jrasm91 - I'll report back if I see more. Network error would be curious since it's not distributed and in the same docker network running on the same host.