Effect CommunityEC
Effect Community4mo ago
5 replies
Afonso Matos

Concerns About Overhead with `embedMany` Creating Thousands of Spans

When using embedMany for a couple thousands embeddings, it still creates thousands of spans for AiEmbeddingModel.embed (instead of a single embedMany span).

Seems a bit unnecessary and it's an overhead sending potentially millions of spans.

What do you think?
Was this page helpful?