Monitors freeze and don't update occasionally

This is a strange thing, but every so often, one of my monitors (not the one with my cursor on it) will freeze and stop updating. Moving the cursor to the frozen monitor still let's me interact, and Audio continually to play, but less than 2 minutes later the other monitor will freeze and the only thing I can do to recover from this state is restarting my computer