Scraping Timeouts
Hey right now almost every scraping request fails through a timeout (requests that worked before). Any outage/incidents rn?
4 Replies
example id of a failed scraping job:
f6635415-2d29-4abb-8a33-e823662ac7e6
This is happening for me as well. Every job has been timing out for the past hour.
I thought I was doing something wrong (I am new to Firecrawl) but this is probably my issue as well.
Just to add some details, in case the aid in troubleshooting. I am using Dify and I can get it to work if the page limit is set to 10 but the exact same settings with a limit of 3000 then fails to run. Firecrawl team - feel free to DM me for more details / retesting etc.
Hey yall, judging by the time, there were some issues yesterday morning (et time) with our deployment provider in some edge locations. We believe this caused a small number of /scrape to take longer than they should. They have fixed the issue.
Let me know if this still occurs and I will investigate your acccounts further