This release brings major improvements to security and reliability:
Protect your LLM applications with the new
modelArmor middleware in @genkit-ai/google-cloud. It integrates Google Cloud Model Armor to sanitize user prompts and model responses, filtering out PII, jailbreaks, and more.Learn more.
Build resilient flows that persist state across client disconnects!
- Reconnect support: Clients can drop and rejoin the same stream.
- Persistence adapters: Built-in support for Firestore and Realtime Database (via
@genkit-ai/firebase).- Framework integration: Works with
expressHandler and Next.js appRoute.We are looking for feedback on this experimental feature, so please try it out and let us know what you think! Learn more.
- Reasoning Tokens: Now displaying token counts for reasoning models.
- Multipart Tool Support: Better visualization for multipart tool responses.
Check out the full changelog here: https://github.com/firebase/genkit/releases/tag/v1.26.0
feat(js/plugins/google-cloud): implemented model armor middleware by @pavelgj in #3904
feat(js): durable streaming for flows (experimental) by @pavelgj in #3770
feat(js/ai): add...