VM Install

So weird thing I'm having an issue with, the VM I created works fine, gpu is passed through and everything seems to be working. However, the moment I try to connect in with Sunshine/moonlight I can't use my mouse or keyboard. I can use RDP/XRDP to connect in perfectly fine. I'm also losing any control when launching PCSX2 (I haven't tested anything else so far). Any ideas what's happening??