Can I do this?
Can I do either or both of the following:
1) Provide Firecrawl with a list of keywords and/or key phrases and have it do a search, and then crawl the returned websites to scrape for those keywords/phrases? -OR-
2) Provide Firecrawl with a list of urls to crawl and scrape for those keywords/phrases?
Thank you.
1 Reply
Hi @GaiaGrower,
Yes, you can do both with Firecrawl.
You can provide keywords in the search query - https://docs.firecrawl.dev/api-reference/endpoint/search#supported-query-operators which will return the the URLs having specific keywords and then crawl them to scrape those keywords or phrases. I would recommend to setup an automation such as n8n to automate this - https://www.firecrawl.dev/blog (examples).