Extract API - Captcha or Bot Solution
Guys, anyone know if Extract API has captcha/bot detect solution embedded? Because I'm trying to crawler a site and I received status success but the data of crawler was empty.
3 Replies
Hey! Yeah, you can set
proxy to stealth or auto in https://docs.firecrawl.dev/api-reference/endpoint/extract#body-scrape-options-proxy to accomplish that.Hi @micah.stairs , I tried using the stealth proxy configuration, but it doesn't return any information (the URL I'm trying to extract is: https://www.epocacosmeticos.com.br/) - This page requires CAPTCHA validation when it is a bot.
API POST: https://api.firecrawl.dev/v1/extract
Body
{
"urls": ["{{$json.body.url_page}}"],
"prompt": "Extract a list of products with prices and promotions.",
"scrapeOptions": {
"proxy" : "stealth"
}
}
Return:
[
{
"success":true,
"data":{
"products":[
]
},
"status":"completed",
"expiresAt":"2025-08-09T03:53:52.000Z",
"tokensUsed":303
}
]For this, I would recommend using a /scrape endpoint with JSON scraping mode, which should be more reliable (and cheaper). And to bypass this particular captcha, you can use actions.
Hey there,
It's been a while since we've last heard from you, so we are going to go ahead and close out this ticket.
Feel free to open a new one, as needed!