Scraping yelp.com
Hey, just wondering how proficient is Firecrawl at scraping yelp.com?
I’m developing a product that relies on scraping businesses profile details from ‘yep.com/biz/{x}’ pages.
Firecrawl works when I test it on a few pages, but I’m worried about it getting blocked by Captcha when deployed at scale.
I’m not so worried about being IP blocked, as it seems that Firecrawl handles this.
Any insights here?
I’m developing a product that relies on scraping businesses profile details from ‘yep.com/biz/{x}’ pages.
Firecrawl works when I test it on a few pages, but I’m worried about it getting blocked by Captcha when deployed at scale.
I’m not so worried about being IP blocked, as it seems that Firecrawl handles this.
Any insights here?
