Can't get vLLM V2.11.3 serverless to work
⏩Queue🫙Model Store
I've tried a variety of different models and i keep getting the same error, tried Qwen/Qwen2.5-1.5B-Instruct for example and Llama-3.2-3B-Instruct:
AttributeError: TokenizersBackend has no attribute all_special_tokens_extended. Did you mean: 'num_special_tokens_to_add'?\n
or AttributeError: Qwen2Tokenizer has no attribute all_special_tokens_extended. Did you mean: 'num_special_tokens_to_add'?\n
AttributeError: TokenizersBackend has no attribute all_special_tokens_extended. Did you mean: 'num_special_tokens_to_add'?\n
or AttributeError: Qwen2Tokenizer has no attribute all_special_tokens_extended. Did you mean: 'num_special_tokens_to_add'?\n
