ImmichI
Immich•2y ago
eKristensen

Orange Pi 5 Plus Rockchip RK3588 Hardware ML Acceleration segfault help wanted

AI have an Orange Pi 5 Plus that I'm trying to setup for running Immich: I want to enjoy hardware accelerated machine learning. I've been having quite a bit of trouble getting the driver to work.

I am confident that my Immich setup is correct and that I have given the container proper access to the hardware. Why? Because when I run clinfo in the machine it can see the OpenCL hardware.

Furthermore https://immich.app/docs/features/ml-hardware-acceleration/ says
In the case of ARM NN, the absence of a Could not load ANN shared libraries log entry means it loaded successfully.
And I do NOT get the load error.

I've tried the https://github.com/JeffyCN/mirrors/raw/libmali/firmware/g610/mali_csffw.binq and equivalent from https://github.com/tsukumijima/libmali-rockchip/releases
I got the firmware from https://github.com/JeffyCN/mirrors/raw/libmali/firmware/g610/mali_csffw.binq but it does not make any difference no-matter if I include that file or not.

Between each test I've completely reset the system nuking all images and deleting storage. I get a segfault when the machine learning algo runs

Relevant logs attached, and part with error highlighted below:
/opt/venv/lib/python3.11/site-packages/skimage/transform/_geometric.py:160: RuntimeWarning: divide by zero encountered in divide
  scale = 1.0 / src_demean.var(axis=0).sum() * (S @ d)
[07/31/24 22:06:51] DEBUG    Checking for inactivity...                         
/opt/venv/lib/python3.11/site-packages/skimage/transform/_geometric.py:165: RuntimeWarning: invalid value encountered in multiply
  T[:dim, :dim] *= scale
[07/31/24 22:07:01] ERROR    Worker (pid:5) was sent SIGSEGV!
message.txt7.35KB
message.txt17.03KB
Was this page helpful?