CAN works, then don't!

My CAN connection is all fine and dandy on start-up, but after a while it fades with only a few connections, only to die. Anyone experienced this or have an idea for trouble shooting?
Restarting the Pi restarts the CAN connection. Restarting SignalK server doesn't.