Thread to keep track of instances where the integration fails to autodiscover hass.agent instances.
Solution
Well it seems that worked this time. I guess that it's because i have all machines on the new agent now. Fully uninstalling the old agent on the client machines and installing the new one may have helped....? fwiw, I kinda wish there was a different name for this new agent, it's difficult to make the distinction between the old and the new....even though it's the same thing with continued development.