"Error saving template. Please contact support or try again later." when using vLLM Quick Deploy
I managed to launch two endpoints successfully. The third endpoint displays the error above when I click "Deploy".
Solution:Jump to solution
Hey Gabriel! I believe to found the issue. We used the model name as a prefix for template name but it caused issues when the model name is too long (for example llama-3-8b-instruct)
A fix will be rolling out in the next few days. Sorry for the inconvenience!...
3 Replies
Thsi breaks when the HF repository name is too long... pls fix!
What's the HF model name?
Solution
Hey Gabriel! I believe to found the issue. We used the model name as a prefix for template name but it caused issues when the model name is too long (for example llama-3-8b-instruct)
A fix will be rolling out in the next few days. Sorry for the inconvenience!