WIll there be any multimodal embedding
WIll there be any multimodal embedding models exposed via the npm package for vertex ai or should we just start building with the REST endpoint?
Recent Announcements
# 📢 Genkit JS and Dev UI 1.27.0 have been released! 🚀 This update introduces REALTIME TELEMETRY! ⚡️ You can now watch traces stream live in the Dev UI as you run your flows. Other key improvements: ✨ OpenAI API Plugin: - Pass API keys at runtime (instead of at config time) - Support for PDF and base64 file inputs 🛠️ Dev UI: - Stream telemetry in realtime for both JS and Go!!! - Collapsible code blocks for cleaner views Check out the full release notes here: https://github.com/firebase/genkit/releases/tag/v1.27.0
efficient-indigo · 4w ago
📢 **Genkit JS 1.26.0 is out!** 🚀 This release brings major improvements to security and reliability: 🛡️ **Model Armor Support** Protect your LLM applications with the new `modelArmor` middleware in `@genkit-ai/google-cloud`. It integrates Google Cloud Model Armor to sanitize user prompts and model responses, filtering out PII, jailbreaks, and more. [Learn more.](https://genkit.dev/docs/integrations/google-cloud/#model-armor) 🔄 **Durable Streaming (Experimental)** Build resilient flows that persist state across client disconnects! - **Reconnect support**: Clients can drop and rejoin the same stream. - **Persistence adapters**: Built-in support for Firestore and Realtime Database (via `@genkit-ai/firebase`). - **Framework integration**: Works with `expressHandler` and Next.js `appRoute`. We are looking for feedback on this experimental feature, so please try it out and let us know what you think! [Learn more](https://genkit.dev/docs/durable-streaming/). 🛠️ **Dev UI Improvements** - **Reasoning Tokens**: Now displaying token counts for reasoning models. - **Multipart Tool Support**: Better visualization for multipart tool responses. Check out the full changelog here: https://github.com/firebase/genkit/releases/tag/v1.26.0
efficient-indigo · 5w ago
# Talk to the Genkit team 📣 👂 Hi friends, **We are opening up customer discussion slots for you to hop on a call with the the Genkit team. ** This is an opportunity to provide feedback, preview some new ideas, and influence Genkit's roadmap to help serve you better! ➡️ [**Book a call now**](https://calendar.app.google/aUoTtjsZdBdT2XFL7) ⬅️ If the available times don't work for your timezone, DM me directly and we'll work something out 😁
managerial-maroon · 2mo ago
