best way to structure a `/scrape` request
Hey everyone 👋
We’re integrating Firecrawl into our app (TOOTYA) and would love some help from the community.
We’re trying to figure out the best way to structure a
✅ Tips on using
✅ Any lessons learned from avoiding over-scans or empty results Thanks in advance! 🙏
/scrape request that reliably:
- extracts structured business info (like services, contact, tech stack),
- doesn’t fail with 400s,
- and limits the crawl scope (we accidentally scanned 889 pages today 😬).
Would really appreciate:
✅ A working example of a solid crawl request✅ Tips on using
extract.prompt effectively✅ Any lessons learned from avoiding over-scans or empty results Thanks in advance! 🙏
1 Reply
Use the excludePaths or includePaths to limit. also you can limit the amount of urls