yarn version incorrect despite choosing version 2

I am getting this error when running the CLI

Yarn version is incompatible. Please make sure you use Yarn version >= 1 and <3.

Yarn version is incompatible. Please make sure you use Yarn version >= 1 and <3.

Yarn version is incompatible. Please make sure you use Yarn version >= 1 and <3.

Yarn version is incompatible. Please make sure you use Yarn version >= 1 and <3.

However when checking the version I've switched to version 2 of yarn

yarn -v 
# comes back with "2.4.3"

yarn -v 
# comes back with "2.4.3"

yarn -v 
# comes back with "2.4.3"

yarn -v 
# comes back with "2.4.3"