Firecrawl•15mo ago

Playground Crawler Not Functioning

Hello FireCrawl Community, I hope you are all doing well. I have been trying to use FireCrawl for a project, but I am encountering some issues and could use your expertise. Problem 1: PlayGround No Response I attempted to run a crawl using the PlayGround feature, but I received no response. I have attached a video that demonstrates my actions and the resulting lack of response. I would appreciate it if someone could take a look and provide any insights on what might be going wrong. Problem 2: API Challenges In addition, I tried to use the API and received the following message: {"status":"failed","current":1,"current_url":"","current_step":"SCRAPING","total":100,"data":[]} I am unsure what is causing this issue and how to resolve it. If anyone has experienced similar problems or knows how to address this, your advice would be invaluable. Thank you in advance for your assistance! Best regards,

9 Replies

scoopful•15mo ago

Hey all I am experiencing the same issue since yesterday

DrBanny•15mo ago

same here

chichin•15mo ago

Hello everyone! Same to me, playground fails due to 502 status from firecrawl API. Also, API responses with 502 status for /scrape and /crawl for my applications too. That is request example

curl 'https://api.firecrawl.dev/v0/scrape' \
  -H 'authority: api.firecrawl.dev' \
  -H 'accept: */*' \
  -H 'accept-language: en-US,en;q=0.9' \
  -H 'authorization: Bearer token' \
  -H 'cache-control: no-cache' \
  -H 'content-type: application/json' \
  -H 'origin: https://www.firecrawl.dev' \
  -H 'pragma: no-cache' \
  -H 'referer: https://www.firecrawl.dev/' \
  -H 'sec-ch-ua: "Chromium";v="119", "Not?A_Brand";v="24"' \
  -H 'sec-ch-ua-mobile: ?0' \
  -H 'sec-ch-ua-platform: "Linux"' \
  -H 'sec-fetch-dest: empty' \
  -H 'sec-fetch-mode: cors' \
  -H 'sec-fetch-site: same-site' \
  -H 'user-agent: Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/119.0.0.0 Safari/537.36' \
  --data-raw '{"url":"https://cleartrust.cc/","crawlerOptions":{"generateImgAltText":false},"pageOptions":{"onlyMainContent":false,"includeHtml":false},"origin":"website"}' \
  --compressed

curl 'https://api.firecrawl.dev/v0/scrape' \
  -H 'authority: api.firecrawl.dev' \
  -H 'accept: */*' \
  -H 'accept-language: en-US,en;q=0.9' \
  -H 'authorization: Bearer token' \
  -H 'cache-control: no-cache' \
  -H 'content-type: application/json' \
  -H 'origin: https://www.firecrawl.dev' \
  -H 'pragma: no-cache' \
  -H 'referer: https://www.firecrawl.dev/' \
  -H 'sec-ch-ua: "Chromium";v="119", "Not?A_Brand";v="24"' \
  -H 'sec-ch-ua-mobile: ?0' \
  -H 'sec-ch-ua-platform: "Linux"' \
  -H 'sec-fetch-dest: empty' \
  -H 'sec-fetch-mode: cors' \
  -H 'sec-fetch-site: same-site' \
  -H 'user-agent: Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/119.0.0.0 Safari/537.36' \
  --data-raw '{"url":"https://cleartrust.cc/","crawlerOptions":{"generateImgAltText":false},"pageOptions":{"onlyMainContent":false,"includeHtml":false},"origin":"website"}' \
  --compressed

Sachin•15mo ago

Hey guys, have been experiencing this issue at my end as well. Though the STATUS of firecrawl services is operational. Not sure how they are not able to detect such issues.

FND•15mo ago

Same, everything is dead on my side Both API, playground

dhruvs•15mo ago

Same, any insight @Adobe.Flash ?

Julia Schroder•15mo ago

Same here, getting Bad Gateway responses on all my requests

p3nnywh1stl3•15mo ago

same results for me

Adobe.Flash•15mo ago

Hey yall, we're on in it. Apologies again for the unexpected downtime in /crawl. It seems like our fast storage provider literally blocked our storage in the middle of the night in some edge locations, leading the crawl queue to get destroyed. We just switched providers everything should be back. In the meantime we're contacting them to address this and make sure it never happens again.

Gaming

Programming

Playground Crawler Not Functioning

Did you find this page helpful?