goodwood - How do you use the new Semantic Inde...

How do you use the new Semantic Index? Is it possible to configure a crawl or extract job to only run against something new in the last 24 hours?
2 Replies
Gaurav Chadha
Gaurav Chadha2mo ago
Hi @goodwood, Semantic Index is just maxAge for extracting something new, if it's newer than 2 days, it is returned instantly. note: We return a result from the cache if the age of the cached content is newer than the maxAge they specify https://docs.firecrawl.dev/features/scrape#caching-and-maxage
Firecrawl Docs
Scrape | Firecrawl
Turn any url into clean data
goodwood
goodwoodOP2mo ago
Ok understood, thanks.

Did you find this page helpful?