chat template not supported
Am using runpod serverless initially with Deepseek R1 from huggingface, then switched to Llama4-scout for testing but I got this error. No issues on the huggingface side, the model is exactly the same as it was.
Output:
{ "delayTime": 48454, "error": "{'object': 'error', 'message': 'Chat template does not exist for this model, you must provide a single string input instead of a list of messages', 'type': 'BadRequestError', 'param': None, 'code': 400}", "executionTime": 254, "id": "2bee8688-4f7e-4d8d-b198-3ad3054f34d8-u2", "status": "FAILED", "workerId": "9sxpstx8jawche" }
Switched back to deepseek-r1 and still getting the same message.
Nothing was changed but there are processes dependent on this.
Here is the input:
{"input": {
"messages": [
{"role": "system", "content": "You are a physics expert."},
{"role": "user", "content": "What is gravity?"}
]
}}
14 Replies
Unknown User•2mo ago
Message Not Public
Sign In & Join Server To View
We changed models in the past and this issue never came up. I don't think its a hf model issue.
Unknown User•2mo ago
Message Not Public
Sign In & Join Server To View
We werent using vllm for deployment.
we were using the preset models.
GitHub
chat template not supported · Issue #449 · runpod/runpod-python
Am using runpod serverless initially with Deepseek R1 from huggingface, then switched to Llama4-scout for testing but I got this error. No issues on the huggingface side, the model is exactly the s...
@Jason any update?
@Partha K
Escalated To Zendesk
The thread has been escalated to Zendesk!
Ticket ID: #21068
Unknown User•2mo ago
Message Not Public
Sign In & Join Server To View
We do not offer preset models. Quick deploy just pull list of models from huggingface but it does not provide settings.
Understood. But then why is it causing that issue?
Unknown User•4w ago
Message Not Public
Sign In & Join Server To View
Cause the model does not have correct chat template
We are using the same template that was given to us by your support. Not sure what you mean does not have the correct chat template.
aka model hosted on hugging face does not include chat template in their repo or it's in not correct format