Crawling 101 Doubts
Hey so im trying to crawl a website using FireCrawl and my aim is to create a RAG System from the crawled data, So is it possible to get the output after crawl in json format or will it be better if I get the response in markdown itself,which format will be better for RAG System ?
2 Replies
Hi! Markdown is better for RAG.
@ro0t also our startup has built a RAG system on top of FireCrawl. You can test it out for free here: https://www.jamix.ai/website-demo
Jamix - Chat about a website
Enter a website URL and we'll email you an AI agent to chat with.