Buzzing noise when starting proton games

I have wired headphones, connected to audio output on the PC case front. When starting a game from Steam that uses proton, I hear a definite humming-buzzing-static-interference noise. This noise is not completely constant, it becomes quieter and louder depending on, what I assume, the volume of the in game sound, sometimes even disappearing, but it consistently happens and is very noticeable, especially when launching the game. Notably, there are no other issues, like breaking or stuttering, just this noise. So far I narrowed it down to just Proton games, but not even every proton game (skyrim seemingly had no issues, maybe it correlates with how resource hungry the game is?). It doesn't happen with native music apps, web browsers and, importantly, native games. I tried everything I found on discord and reddit: changing delay (no effect), changing to ALSA (no effect), setting sampling rate (no effect), changing pulse quantum (it broke everything but I recovered). Where should I look at? I'm moderately confident in using Linux, but Linux desktop audio is not my field of expertise whatsoever