GenkitG
Genkitโ€ข6mo agoโ€ข
1 reply
uncertain-scarlet

Go Evals Feedback

evals feedback for go, we are talking about evals all the time, but the evaluators plugins have the concept of metrics that are evaluators:
    metrics := []evaluators.MetricConfig{
        {
            MetricType: evaluators.EvaluatorDeepEqual,
        },
    }

Metrics for me are more for observability. The code above should be something like this imo:
    evaluators := []evaluators.EvaluatorConfig{
        {
            EvaluatorType: evaluators.EvaluatorDeepEqual,
        },
    }


does this make sense?
Was this page helpful?