I also remember that CachyOS ships some audio realtime rules for this, you can also experiment with
I also remember that CachyOS ships some audio realtime rules for this, you can also experiment with that @saberj2x :
https://github.com/CachyOS/CachyOS-Settings/blob/master/etc/udev/rules.d/99-cpu-dma-latency.rules
https://github.com/CachyOS/CachyOS-Settings/blob/master/etc/security/limits.d/99-audio.conf
https://github.com/CachyOS/CachyOS-Settings/blob/master/etc/security/limits.d/99-realtime.conf
https://github.com/CachyOS/CachyOS-Settings/blob/master/etc/udev/rules.d/99-cpu-dma-latency.rules
https://github.com/CachyOS/CachyOS-Settings/blob/master/etc/security/limits.d/99-audio.conf
https://github.com/CachyOS/CachyOS-Settings/blob/master/etc/security/limits.d/99-realtime.conf
