steam deck controls stop working

Hello I just got the steam deck and used Heroic games launcher, works great however sometimes I get disconnected from my epic games account which isn’t a problem, however I can’t control the game anymore using the deck controls, and the controls become keyboard mouse based only.
I would appreciate any help with this issue.