Modal Listeners "stealing" Interactions from each other

I have the following problem: When a user executes an interaction, the bot shows a modal and then uses awaitModalSubmit() to await a response. However, if the user closes the modal (which won't give the bot anything) and then executes a different command which also shows a modal (and then listens for a response), the first listener will snatch the response of the user and continue execution while the second one throws the error InteractionAlreadyReplied (which is understandable, because the first listener stole it). I've tried making a check with the interaction's ID, but the initial interaction ID is different compared to the ModalSubmit interaction ID.
Is there a way to prevent the listeners stealing each other's interactions?
Was this page helpful?