This issue did not happen on Steam Deck with SteamOS, just my GPD Win 4 7640U with Bazzite.
Enabling FSR (happens on Pixel scaling too) and also enabling any frame limit in Gaming Mode QAM settings causes performance drops and frame pacing issues. GPU usage visibly goes from 99% to around 94%.