Get all website url before crawl
Hi, I wonder how to get the URL list of a website before crawling, like on the Mendable app?
1 Reply
Hi you can pass the returnOnlyUrls param on the crawlerOptions to achieve that! https://docs.firecrawl.dev/api-reference/endpoint/crawl