Firecrawler IP for a whitelist
I'm trying to scrape a website that blocks scraping, but we control.
Is there a firecrawler IP address that we can use to whitelist firecrawler?
Or do we need to self-host
1 Reply
You could can pass some custom header and check for that