I
Immich•4w ago
Divini

Prometheus Metrics missing

Hi, I tried to set up Prometheus Metrics and a Grafana dashboard for my immich instance in Kubernetes, I found no issues on this but it seems that the Metrics immich_server_stats* are not available in the current immich version, is that correct or am I missing something? I set IMMICH_TELEMETRY_INCLUDE=all and IMMICH_METRICS=true (this one seems legacy and didn´t change behaviour as far as I could gather) When manually curl-ing the metrics endpoints and grepping for "stats" I can also not find anything. Dashboard in question is from: https://github.com/friendlyFriend4000/prometheus-immich-exporter/blob/master/grafana/dashboard-immich_1_2_X.json I also tried https://grafana.com/grafana/dashboards/22555-immich-overview/ which also uses those non existent metrics. Helm Values: 
env:
  - name: REDIS_PASSWORD
    valueFrom:
      secretKeyRef:
        name: immich-secret
        key: dragonfly-password
  - name: REDIS_HOSTNAME
    value: immich-dragonfly.immich.svc.cluster.local
  - name: IMMICH_TELEMETRY_INCLUDE
    value: all
  - name: IMMICH_METRICS
    value: true
  - name: DB_HOSTNAME
    value: immich-cnpg-cluster-rw.immich.svc.cluster.local
  - name: DB_USERNAME
    value: immich
  - name: DB_DATABASE_NAME
    value: immich
  - name: DB_VECTOR_EXTENSION
    value: pgvector
  - name: DB_PASSWORD
    valueFrom:
      secretKeyRef:
        name: immich-cnpg-cluster-app
        key: password
  - name: IMMICH_MACHINE_LEARNING_URL
    value: http://immich-machine-learning.immich.svc.cluster.local:3003
image:
  tag: v1.140.1
machine-learning:
  resources:
    limits:
      memory: 2Gi
    requests:
      cpu: 500m
      memory: 1Gi
server:
  resources:
    limits:
      memory: 3Gi
    requests:
      cpu: 500m
      memory: 1Gi
  ingress:
    main:
      enabled: true
      annotations:
        cert-manager.io/cluster-issuer: letsencrypt-issuer
      hosts:
        - host: immich.example.com
          paths:
            - path: "/"
      tls:
        - hosts:
            - 'immich.example.com'
          secretName: immich-cert
controller:
  strategy: Recreate 
immich:
  metrics:
    enabled: true
  persistence:
    library:
      existingClaim: immich-data
  configuration: {}
    # trash:
    #   enabled: false
    #   days: 30
    # storageTemplate:
    #   enabled: true
    #   template: "{{y}}/{{y}}-{{MM}}-{{dd}}/{{filename}}"
env:
  - name: REDIS_PASSWORD
    valueFrom:
      secretKeyRef:
        name: immich-secret
        key: dragonfly-password
  - name: REDIS_HOSTNAME
    value: immich-dragonfly.immich.svc.cluster.local
  - name: IMMICH_TELEMETRY_INCLUDE
    value: all
  - name: IMMICH_METRICS
    value: true
  - name: DB_HOSTNAME
    value: immich-cnpg-cluster-rw.immich.svc.cluster.local
  - name: DB_USERNAME
    value: immich
  - name: DB_DATABASE_NAME
    value: immich
  - name: DB_VECTOR_EXTENSION
    value: pgvector
  - name: DB_PASSWORD
    valueFrom:
      secretKeyRef:
        name: immich-cnpg-cluster-app
        key: password
  - name: IMMICH_MACHINE_LEARNING_URL
    value: http://immich-machine-learning.immich.svc.cluster.local:3003
image:
  tag: v1.140.1
machine-learning:
  resources:
    limits:
      memory: 2Gi
    requests:
      cpu: 500m
      memory: 1Gi
server:
  resources:
    limits:
      memory: 3Gi
    requests:
      cpu: 500m
      memory: 1Gi
  ingress:
    main:
      enabled: true
      annotations:
        cert-manager.io/cluster-issuer: letsencrypt-issuer
      hosts:
        - host: immich.example.com
          paths:
            - path: "/"
      tls:
        - hosts:
            - 'immich.example.com'
          secretName: immich-cert
controller:
  strategy: Recreate 
immich:
  metrics:
    enabled: true
  persistence:
    library:
      existingClaim: immich-data
  configuration: {}
    # trash:
    #   enabled: false
    #   days: 30
    # storageTemplate:
    #   enabled: true
    #   template: "{{y}}/{{y}}-{{MM}}-{{dd}}/{{filename}}"
No description
No description
3 Replies
Immich
Immich•4w ago
:wave: Hey @Divini, Thanks for reaching out to us. Please carefully read this message and follow the recommended actions. This will help us be more effective in our support effort and leave more time for building Immich :immich:. References - Container Logs: docker compose logs docs - Container Status: docker ps -a docs - Reverse Proxy: https://immich.app/docs/administration/reverse-proxy - Code Formatting https://support.discord.com/hc/en-us/articles/210298617-Markdown-Text-101-Chat-Formatting-Bold-Italic-Underline#h_01GY0DAKGXDEHE263BCAYEGFJA Checklist I have... 1. :ballot_box_with_check: verified I'm on the latest release(note that mobile app releases may take some time). 2. :ballot_box_with_check: read applicable release notes. 3. :ballot_box_with_check: reviewed the FAQs for known issues. 4. :ballot_box_with_check: reviewed Github for known issues. 5. :ballot_box_with_check: tried accessing Immich via local ip (without a custom reverse proxy). 6. :ballot_box_with_check: uploaded the relevant information (see below). 7. :ballot_box_with_check: tried an incognito window, disabled extensions, cleared mobile app cache, logged out and back in, different browsers, etc. as applicable (an item can be marked as "complete" by reacting with the appropriate number) Information In order to be able to effectively help you, we need you to provide clear information to show what the problem is. The exact details needed vary per case, but here is a list of things to consider: - Your docker-compose.yml and .env files. - Logs from all the containers and their status (see above). - All the troubleshooting steps you've tried so far. - Any recent changes you've made to Immich or your system. - Details about your system (both software/OS and hardware). - Details about your storage (filesystems, type of disks, output of commands like fdisk -l and df -h). - The version of the Immich server, mobile app, and other relevant pieces. - Any other information that you think might be relevant. Please paste files and logs with proper code formatting, and especially avoid blurry screenshots. Without the right information we can't work out what the problem is. Help us help you ;) If this ticket can be closed you can use the /close command, and re-open it later if needed. Successfully submitted, a tag has been added to inform contributors. :white_check_mark:
bo0tzz
bo0tzz•4w ago
Idk about the other but that first dashboard you linked is from a third party tool that generates metrics, not for the Immich native ones
Divini
DiviniOP•4w ago
Oh my god I didnt realize that Yeah the other one uses the same Metric Names so I´d need to set up that 3rd party metrics exporter if I wanted that, thanks for the answer!

Did you find this page helpful?