Firecrawl

F

Firecrawl

Join builders, developers, users and turn any website into LLM-ready data, enabling developers to power their AI applications with clean, structured information crawled from the web.

Join

❓┃community-help

💬┃general

🛠️┃self-hosting

LeQuocThai - Hi, firecrawl-playwright-service-1...

Hi, firecrawl-playwright-service-1 stopped on the docker services, does it ok? I still crawler and get result. But I don't know firecrawl-playwright-service-1 still stop, that strange, should I remove this image from docker?
No description

Jack74r - Hi , selfhosted it's possible to craw...

Hi , i have issue with selfhosted custom prompt, it"s work on cloud with exact same query ? I try to add in scrap option but it's return completed but empty data only when i set this option And sometime return : Only 0 result(s) found. For broader coverage, try crawling with crawlEntireDomain=true or start from a higher-level path like ... I dont understand the issue when i add custom prompt because its not get the full data on the page (and crawlentiredomain is set to true ...) ...

SpooKyHammer - Hello, what's the recommend spec...

Hello, what's the recommend spec to self host firecrawl? I am currently trying it out 2 vCPU and 4GB ram but its crashes the server after running successful crawl on 20-30 websites. and does it internally cache things if so how can I disable it?

captainspazz - No I haven’t. Was just browsing ...

No I haven’t. Was just browsing the discord and noticed this.

Trevor K Smith - what models are people using w...

what models are people using with ollama? which work best?

shoob - is screenshot not supported for self ho...

is screenshot not supported for self hosted firecrawl via v2 scrape?

Casper - Hello, do you know what is the scrape ...

Hello, do you know what is the scrape endpoint for open source local firecrawl?

This might be useful for some starting

This might be useful for some starting with self-hosting; just to quickly understand what's going on
No description

scrape - json mode

I am trying to migrate from the cloud version to the self hosted version. The scrape - json format mode was working fine in the cloud based firecrawl api call. However, when I tried the self hosted version, its showing this error
Failed to parse URL from /chat/completions
Failed to parse URL from /chat/completions
The self hosted version is working fine for normal scraping, also I have provided the openai key through the env...

docker (firecrawl-api-container) debug

Hi guys, first time firecrawl user here. I just installed it using docker on my ubuntu ec2 instance. The docker compose build command ran without any issues and then i ran docker compose up -d which gave me this output: ``` [+] Running 4/4 ✔ Container firecrawl-playwright-service-1 Running 0.0s ✔ Container firecrawl-redis-1 Running 0.0s...

Self-host Firecrawl (store data)

I might be missing something but the self-host docs are kind of sparse: where can I configure persistence for scraped data? I ran a crawl, saw data when checking on the crawl via the API, took down the containers, brought them back up, and now the data is empty when I check via the API.again

What are the error logs capturing?

What are the error logs capturing?
Firecrawl Community - Answer Overflow