Firecrawl

Join builders, developers, users and turn any website into LLM-ready data, enabling developers to power their AI applications with clean, structured information crawled from the web.

Join

Firecrawl

Join builders, developers, users and turn any website into LLM-ready data, enabling developers to power their AI applications with clean, structured information crawled from the web.

Join

❓┃community-help

💬┃general

🛠️┃self-hosting

! Ali ( smart dev ) !

11/20/2025

! Ali ( smart dev ) ! - I am a Scraping Automa...

I am a Scraping Automation Crawling Dev

ali-portfolio-com.vercel.app/
github.com/ali00061

ali-portfolio-com.vercel.app/
github.com/ali00061

...

Robint

11/19/2025

Robint - Hi guys, i just created a scenario on ...

Hi guys, i just created a scenario on Make.com to automate scrapping of the website "https://www.selogerneuf.com". It worked all day but suddenly tonight it stoped working and i get this error type. Is it possible that the website is not scrapable with Firecrawl anymore ? If someone has a solution or advice it would help me a lot ! ...

SpooKyHammer

11/19/2025

SpooKyHammer - Hello, what's the recommend spec...

Hello, what's the recommend spec to self host firecrawl? I am currently trying it out 2 vCPU and 4GB ram but its crashes the server after running successful crawl on 20-30 websites. and does it internally cache things if so how can I disable it?

Minh Thông

11/18/2025

Minh Thông - Hi guys, could you give me Firecra...

Hi guys, could you give me Firecrawl User-agent name ? So I can allow it in robots.txt. Thanks!

月亮情人

11/15/2025

月亮情人 - hi guys i have a question.. is the api c...

Hi guys, I have a question.. is the api credits free and renewable?

Hamzah

11/14/2025

Hamzah - 2025-11-13 19:42:37.567 [info] Handlin...

2025-11-13 19:42:37.567 [info] Handling ListOfferings action, server stored: false 2025-11-13 19:42:37.567 [error] No server info found...

MCST

11/12/2025

MCST - just created my first account and think ...

just created my account and think those were the most beautiful toggles I have ever toggled.

Chirag

11/12/2025

Chirag - Guys the new branding feature is aweso...

Guys the new branding feature is awesome!! Really great stuff it's very consistent and useful We used firecrawls latest 'branding' scraping API to make the chat bubble colours according to your website which is pretty cool 🤩 this is for the tanstack Hackathon We are using firecrawl extensively for fetching website content to convert to embeddings for knowledge base of the agent. This can be deployed on Discord too for an ask-ai support channel....

ninja

11/12/2025

ninja - Hey

Hey

Minh Thông

11/12/2025

Minh Thông - It is only accessible in Germany i...

Hi Firecrawl team, I need to support from guys. It is only accessible in Germany is there any way to crawl it via Firecrawl API? https://www.erfurt.de/...

Aiqmonks

11/12/2025

Aiqmonks - Has anyone used the Firecrawl APi wi...

Has anyone used the Firecrawl APi with Lovable?

Chowderr

11/11/2025

Chowderr - I am wondering how does one get YouT...

I am wondering how does one get YouTube Transcripts with Firecrawl? I see a ton off other information, but not that. Is there something we should also put in the request?

Raja

11/10/2025

Raja - Hi Team,I’m trying to use the batchScr...

Hi Team, I’m trying to use the batchScrape method through a Node.js script, but I don’t see any jobs appearing in the queue on the UI. Additionally, when I attempt to start batchScrape using the Playground , it requires a webhook URL as a mandatory field....

11/10/2025

a - is firecrawl down? keep getting api errors

is firecrawl down? keep getting api errors

clovisnetogmn

11/10/2025

clovisnetogmn - Hello everyone,My name is Clov...

Hello everyone, My name is Clovis, and I'm writing from Brazil. I hope this is the right place to ask, but I'm starting from scratch in this field and could use some guidance. I would be very grateful for any recommendations on a study roadmap—what to study and where to start. Additionally, if you could suggest any specific courses or YouTube channels, I would really appreciate that as well. Thank you in advance for your help!...

Tom

11/9/2025

Tom - Hi guys, please would any of you know how...

Hi guys, please would any of you know how to handle this use case: I need to scrape jobs (headlines are enough) on career pages of companies. The pages are often paginated. If I use the crawl method, the crawler goes through the pagination, that's good, BUT it also crawles all the child pages (e.g. the details of every single job posting). I don't want the child pages scraped (slow, expensive). How can I scrape just the first level of every page in pagination?...

wsh_virgine

11/9/2025

wsh_virgine - same here, failing.

same here, failing.

11/9/2025

ac - We are getting Firecrawl errors on every s...

We are getting Firecrawl errors on every single scrape request right now -- just started in the past 6-12 hours. Anyone else seeing this?

DogPawHat

11/9/2025

DogPawHat - does the extract endpoint take webh...

does the extract endpoint take webhooks? not seeing anything on the api docs or sdk

Nug

11/6/2025

Nug - What would be the most cost effective way...

What would be the most cost effective way to enrich company electronic products (not every product). Im selling PCB assembly services for electronics products.

Previous Next

Gaming

Programming

Firecrawl

Join builders, developers, users and turn any website into LLM-ready data, enabling developers to power their AI applications with clean, structured information crawled from the web.

Firecrawl

Join builders, developers, users and turn any website into LLM-ready data, enabling developers to power their AI applications with clean, structured information crawled from the web.