Evals Feedback
I'm giving evaluations another go with the default metrics but I get thiss error after everything seems to go right:
- answered: must be string
Provided data:
{
"noncommittal": 0,
"answered": 1,
"question": "What is the wifi code?"
}
Required JSON schema:
{
"type": "object",
"properties": {
"question": {
"type": "string"
},
"answered": {
"type": "string",
"enum": [
"0",
"1"
]
},
"noncommittal": {
"type": "string",
"enum": [
"0",
"1"
]
}
},
"required": [
"question",
"answered",
"noncommittal"
],- answered: must be string
Provided data:
{
"noncommittal": 0,
"answered": 1,
"question": "What is the wifi code?"
}
Required JSON schema:
{
"type": "object",
"properties": {
"question": {
"type": "string"
},
"answered": {
"type": "string",
"enum": [
"0",
"1"
]
},
"noncommittal": {
"type": "string",
"enum": [
"0",
"1"
]
}
},
"required": [
"question",
"answered",
"noncommittal"
],
