GenkitG
Genkitโ€ข14mo ago
awake-maroon

Structured output support in models

Hey y'all, I have a question on structured output support in genkit. Now this is typically something that the model supports or doesn't. Am I able to use genkit structure output features with a model that doesn't support it?

Eg: Gemma2 doesn't support structured output natively. Can I use genkit to get structured output?
Ollama on the other hand support it and I am able to get it working easily, but I am running into errors with Gemma.

Similarly, function calling and tool usage is model dependent. Does genkit work with such models?
Was this page helpful?