Is it possible to get a JSON response from CRAWL via API??
Is it possible to get a JSON response from CRAWL via API?? I need JSON in addition to markdown via API call
1 Reply
Hi @Mark L. Pederson, we do not plan to support llm-extract on our crawl endpoint, since we think it would be prohibitively expensive and not all that useful (crawl will get a lot of different pages with different content -- a specific extraction prompt would probably be inapplicable to a lot of the returned pages)
Let us know if you have a good use case for it though, and we'll see what we can do.