OCR Issues with NVIDIA Remote ML
There are no driver issues. nvidia-smi works.
I rented H100 and it just offloaded to CPU.
Tried A2000 and it worked.
In OCR Settings it uses _server version and resolution increased to 1280 but with bad performance I lessened it to 1080.
Agenda
1. How to resolve this issue?
2. What Hardware is required for me to run high res OCR with _server version. Just need estimated if you have.
3. Thanks for OCR!
name: immich_remote_ml
services:
immich-machine-learning:
container_name: immich-machine-learning
# Use 'release-cuda' for compatibility with new GPUs like the H100
image: ghcr.io/immich-app/immich-machine-learning:release-cuda
hostname: immich-machine-learning
restart: always
environment:
- MACHINE_LEARNING_DEVICE_IDS=0
- MACHINE_LEARNING_WORKERS=1
- NVIDIA_VISIBLE_DEVICES=all
volumes:
- type: bind
source: /tmp/immich-cache
target: /cache
bind:
create_host_path: true
ports:
- "3003:3003" # Port for the main server to connect to
networks:
- default
privileged: false
deploy:
resources:
reservations:
devices:
- driver: nvidia
count: all
capabilities: [gpu]
networks:
default:
# If this network is managed by another docker-compose file,
# you might need to mark it as external:
# external: true
# name: <name_of_your_immich_network>
I rented H100 and it just offloaded to CPU.
Tried A2000 and it worked.
In OCR Settings it uses _server version and resolution increased to 1280 but with bad performance I lessened it to 1080.
Agenda
1. How to resolve this issue?
2. What Hardware is required for me to run high res OCR with _server version. Just need estimated if you have.
3. Thanks for OCR!
name: immich_remote_ml
services:
immich-machine-learning:
container_name: immich-machine-learning
# Use 'release-cuda' for compatibility with new GPUs like the H100
image: ghcr.io/immich-app/immich-machine-learning:release-cuda
hostname: immich-machine-learning
restart: always
environment:
- MACHINE_LEARNING_DEVICE_IDS=0
- MACHINE_LEARNING_WORKERS=1
- NVIDIA_VISIBLE_DEVICES=all
volumes:
- type: bind
source: /tmp/immich-cache
target: /cache
bind:
create_host_path: true
ports:
- "3003:3003" # Port for the main server to connect to
networks:
- default
privileged: false
deploy:
resources:
reservations:
devices:
- driver: nvidia
count: all
capabilities: [gpu]
networks:
default:
# If this network is managed by another docker-compose file,
# you might need to mark it as external:
# external: true
# name: <name_of_your_immich_network>
