I'm not sure i understand you correctly and I'm not very familiar with LLM models, it sounds like yo
I'm not sure i understand you correctly and I'm not very familiar with LLM models, it sounds like you are trying to build a RAG (before LLM gives responding, it refers to some data set you have prepared)? If that's what you are try to do, you can refer to https://developers.cloudflare.com/workers-ai/tutorials/build-a-retrieval-augmented-generation-ai .
In short, RAG is roughly like you need do a simple search by yourself, distill the reference data and make the reference data become much smaller before calling LLM models
As my understanding of the article, I think you can split the json data into many text segments based one some methods(maybe split by git project), using embedding models on workers ai to convert each text to vector, store the origin text to cloudflare D1 and get an ID, store (ID,vector) pair into cloudflare Vectorize. When you run LLM model, you can retrive relevant data through embedding the input and searching the input vector in Vectorize and get some IDs of relevant vectors, retrieve relevant text from D1 by these IDs, and use the relevant data as part of the prompt.
In short, RAG is roughly like you need do a simple search by yourself, distill the reference data and make the reference data become much smaller before calling LLM models
As my understanding of the article, I think you can split the json data into many text segments based one some methods(maybe split by git project), using embedding models on workers ai to convert each text to vector, store the origin text to cloudflare D1 and get an ID, store (ID,vector) pair into cloudflare Vectorize. When you run LLM model, you can retrive relevant data through embedding the input and searching the input vector in Vectorize and get some IDs of relevant vectors, retrieve relevant text from D1 by these IDs, and use the relevant data as part of the prompt.
Cloudflare Docs
This guide will instruct you through setting up and deploying your first application with Cloudflare AI. You will build a fully-featured AI-powered application, using tools like Workers AI, Vectorize, D1, and Cloudflare Workers.
