F
Firecrawl
Join builders, developers, users and turn any website into LLM-ready data, enabling developers to power their AI applications with clean, structured information crawled from the web.
JoinF
Firecrawl
Join builders, developers, users and turn any website into LLM-ready data, enabling developers to power their AI applications with clean, structured information crawled from the web.
JoinDogPawHat - does the extract endpoint take webh...
does the extract endpoint take webhooks? not seeing anything on the api docs or sdk
Nug - What would be the most cost effective way...
What would be the most cost effective way to enrich company electronic products (not every product). Im selling PCB assembly services for electronics products.
brtlmiej - Hi, we tried to use firecrawl /scrap...
Hi, we tried to use firecrawl /scrape endpoint in our product but it seem to be very unstable. We have monitoring tests that check our features health every 5 minutes and during these tests we also send requests to /scrape endpoint (always the same url that is our homepage). Base on our tests statuses firecrawl seem to be very unstable we get a lot of 503 errors from your API. Is this a known issue?
Moinul Moin - asked firecrawl X handler, nobody...
asked firecrawl X handler, nobody answered, so asking here too
for scraping specific category pages from a site, for example, only documentation pages from a documentation site, which one preferable and more accurate,
1. /map+manually url filtering with AI + /scrapebatch ...
Dor Bank - Hi all!I want to use firecrawl to g...
Hi all!
I want to use firecrawl to get the links from a root website.
I understand the 'map' is superfast, but since it uses cache, it misses some links.
If I use crawl, it takes a lot of time (few minutes). even if I only want the links and not the other parts, I can not finds an appropriate way for that.
Ideas?...
Pokey5324 - Hello all - I am looking for guidan...
Hello all - I am looking for guidance with this task - Any tips on how to use Firecrawl to crawl a website and turn it into RDF that is stored in Amazon Neptune
Za warudo - i want to clone front end and backe...
hi guys, i want to clone front end and backend of a website for just fun and educational purpose, how can i do that and what tool i can use
Ash Barbour - Max depth is not working - I set ...
Max depth is not working - I set it to 1 and still I get URLs with like 3 or 4 page depth
Did I miss something?...
LowFatCheese - Hey guys, need some help with cr...
Hey guys, need some help with crawling multiple links in n8n;
I'm pulling the top (upto) 10 links for a SERP keyword, then wanting to get the markdown for further analysis etc.
I'm having trouble getting the firecrawl nodes going over all urls found, instead of just crawling the first url. Any thoughts?...
DolphinDream - I am trying to crawl a site, but...
I am trying to crawl a site, but I'm getting nothing back. Is there anything I can do about it? Can someone help me with this?
dullheavenTM - Hi everyone, my apologies for th...
Hi everyone, my apologies for the spam/scamm, my account was compromised
goodwood - How do you use the new Semantic Inde...
How do you use the new Semantic Index? Is it possible to configure a crawl or extract job to only run against something new in the last 24 hours?
applelamps - I might have to add firecrawl to m...
I might have to add firecrawl to my grokipedia sdk.... i just wonder if i can without breaking it 🤣
https://github.com/AppleLamps/grokipedia-sdk...
AIer - Hey famsIs there anyone looking for a s...
Hey fams
Is there anyone looking for a skilled and reliable developer?
If you contact me, I will show you my project experience and work.
Thanks...
Enzo Surreal - Guys, is your crawl taking a lon...
Guys, is your crawl taking a long time to start? Mine is taking 5 minutes. Even worse, sometimes it doesn't even start scraping. I don't know what's happening...
goodwood - Which endpoint should I use to retur...
Which endpoint should I use to return all open job opportunities, in a structured output, from a list of company websites? Scrape, Crawl, Extract, or a mix?
Lethal_Panda - Self Hosted Firecrawl and Firecr...
Self Hosted Firecrawl and Firecrawl Observer: Wanted to see if there's a supported way to use Observer with the self-hosted firecrawl api?