Effect CommunityEC
Effect Community10mo ago
2 replies
Matt Rossman

Issue with Google's Gemini Models and Effect's OpenAI Client Compatibility

If anyone else is trying to use Google's Gemini's models with @effect/ai-openai through their OpenAI compatibility API, I noticed an issue with Effect's client discarding the streamed content since Google includes "usage" on each chunk whereas OpenAI only includes it on the final chunk.

I submitted a PR to make the client more resilient for this sort of OpenAI compatible APIs: https://github.com/Effect-TS/effect/pull/4630
Was this page helpful?