R
RunPod2w ago
ywid

Strange results in Serverless mode

What Am I doing wrong? Why the response is that strange? I've attached the input params and one of the result.
No description
No description
3 Replies
ywid
ywidOP2w ago
But it working fine, when I'm sending it using the API like with messages instead of prompt
3WaD
3WaD2w ago
See the difference between text completion and chat completion endpoints. Not all models perform well in both modes. Conversation-trained models should be used with chat.
ywid
ywidOP2w ago
@3WaD Thanks!

Did you find this page helpful?