`ImportError: tokenizers>=0.21,<0.22 is required for a normal functioning of this module, but found

ImportError: tokenizers>=0.21,<0.22 is required for a normal functioning of this module, but found tokenizers==0.15.2.
Try: pip install transformers -U or pip install -e '.[dev]' if you're working with git main
Was this page helpful?