Hi everyone! I am writing a post about
Hi everyone! I am writing a post about tool calling, having not used it before in prod, I am surprised that really simple tool calls (getRandom basically) take like 20s using 2.0 Flash, is this normal please?
Recent Announcements
# 📢 Genkit JS and Dev UI 1.27.0 have been released! 🚀 This update introduces REALTIME TELEMETRY! ⚡️ You can now watch traces stream live in the Dev UI as you run your flows. Other key improvements: ✨ OpenAI API Plugin: - Pass API keys at runtime (instead of at config time) - Support for PDF and base64 file inputs 🛠️ Dev UI: - Stream telemetry in realtime for both JS and Go!!! - Collapsible code blocks for cleaner views Check out the full release notes here: https://github.com/firebase/genkit/releases/tag/v1.27.0
efficient-indigo · 4w ago
📢 **Genkit JS 1.26.0 is out!** 🚀 This release brings major improvements to security and reliability: 🛡️ **Model Armor Support** Protect your LLM applications with the new `modelArmor` middleware in `@genkit-ai/google-cloud`. It integrates Google Cloud Model Armor to sanitize user prompts and model responses, filtering out PII, jailbreaks, and more. [Learn more.](https://genkit.dev/docs/integrations/google-cloud/#model-armor) 🔄 **Durable Streaming (Experimental)** Build resilient flows that persist state across client disconnects! - **Reconnect support**: Clients can drop and rejoin the same stream. - **Persistence adapters**: Built-in support for Firestore and Realtime Database (via `@genkit-ai/firebase`). - **Framework integration**: Works with `expressHandler` and Next.js `appRoute`. We are looking for feedback on this experimental feature, so please try it out and let us know what you think! [Learn more](https://genkit.dev/docs/durable-streaming/). 🛠️ **Dev UI Improvements** - **Reasoning Tokens**: Now displaying token counts for reasoning models. - **Multipart Tool Support**: Better visualization for multipart tool responses. Check out the full changelog here: https://github.com/firebase/genkit/releases/tag/v1.26.0
efficient-indigo · 5w ago
# Talk to the Genkit team 📣 👂 Hi friends, **We are opening up customer discussion slots for you to hop on a call with the the Genkit team. ** This is an opportunity to provide feedback, preview some new ideas, and influence Genkit's roadmap to help serve you better! ➡️ [**Book a call now**](https://calendar.app.google/aUoTtjsZdBdT2XFL7) ⬅️ If the available times don't work for your timezone, DM me directly and we'll work something out 😁
managerial-maroon · 2mo ago
