Question:
This is a code snippet from my RAG server. I'm trying to prevent duplicate documents from being added during the indexing process.
Is there a way to avoid adding the same document more than once when calling Index?
doc := ai.DocumentFromText(string(b), nil)
err = ai.Index(ctx, winHistoryIndexer,
ai.WithDocs(doc),
)# ๐ข Genkit JS and Dev UI 1.27.0 have been released! ๐ This update introduces REALTIME TELEMETRY! โก๏ธ You can now watch traces stream live in the Dev UI as you run your flows. Other key improvements: โจ OpenAI API Plugin: - Pass API keys at runtime (instead of at config time) - Support for PDF and base64 file inputs ๐ ๏ธ Dev UI: - Stream telemetry in realtime for both JS and Go!!! - Collapsible code blocks for cleaner views Check out the full release notes here: https://github.com/firebase/genkit/releases/tag/v1.27.0
efficient-indigo ยท 3w ago
๐ข **Genkit JS 1.26.0 is out!** ๐ This release brings major improvements to security and reliability: ๐ก๏ธ **Model Armor Support** Protect your LLM applications with the new `modelArmor` middleware in `@genkit-ai/google-cloud`. It integrates Google Cloud Model Armor to sanitize user prompts and model responses, filtering out PII, jailbreaks, and more. [Learn more.](https://genkit.dev/docs/integrations/google-cloud/#model-armor) ๐ **Durable Streaming (Experimental)** Build resilient flows that persist state across client disconnects! - **Reconnect support**: Clients can drop and rejoin the same stream. - **Persistence adapters**: Built-in support for Firestore and Realtime Database (via `@genkit-ai/firebase`). - **Framework integration**: Works with `expressHandler` and Next.js `appRoute`. We are looking for feedback on this experimental feature, so please try it out and let us know what you think! [Learn more](https://genkit.dev/docs/durable-streaming/). ๐ ๏ธ **Dev UI Improvements** - **Reasoning Tokens**: Now displaying token counts for reasoning models. - **Multipart Tool Support**: Better visualization for multipart tool responses. Check out the full changelog here: https://github.com/firebase/genkit/releases/tag/v1.26.0
efficient-indigo ยท 4w ago