Debugging /map endpoint
I'm looking to map the URLs on this Intercom-hosted support center: https://intercom.help/autods---new/en/
I'd expect 49 articles, based on the website's table of contents, but the map endpoint is only returning two results when I run it in the playground. I have tried ignoring the sitemap and gotten the same results.
AutoDS Help Center
AutoDS Help Center
1 Reply
Hey there,
The /map endpoint is quite cheap and fast, however, it doesn't guarantee that all of the webpages will be found or that they are all still valid, since we do not actually do a full crawl of the website. Instead, you could consider using the /crawl endpoint for this use case. You can check out the documentation for it here.
Hope that helps!