export-gpu not ignoring Nvidia GPU completely for gamescope-session

My PC is running 2 dGPUs, a RX 6700 XT which has a HDMI dummy plug connected, and a RTX 2060 I connected just to have CUDA available in the background.
I want to use Steam Game Mode so I tried using export-gpu to select the 6700xt and it works for the most part, but the performance overlay from Steam does not work, and some pages of the Steam UI turns black completely (which I supposed is being done on the Nvidia GPU) but actually has the performance overlay
So I ran nvidia-smi and got this result
+-----------------------------------------------------------------------------------------+
| Processes:                                                                              |
|  GPU   GI   CI              PID   Type   Process name                        GPU Memory |
|        ID   ID                                                               Usage      |
|=========================================================================================|
|    0   N/A  N/A            2300      G   /usr/bin/gamescope                        1MiB |
+-----------------------------------------------------------------------------------------+

Is there anything I can do so that the Nvidia GPU is literally cannot be used for anything other than CUDA? I guess that can fix this small issue with Game Mode
Was this page helpful?