F
Firecrawl•12mo ago
Maan

html element crawl

Hi there, is it possible to hit the particular element in the webpage using crawl method i.e i want to get the content of all the pages inisde <div id="readable"></div> -- Right now crawl param does starts from very start that doesnot mean anything important...
1 Reply
rafaelmiller
rafaelmiller•12mo ago
Hi @Maan! You can use the parameter scrapeOptions.includeTags to get only the html tags you need. In this case the request would look like: 
{
  "url": "<url to crawl>",
   "scrapeOptions": {
    "includeTags": ["#readable"]
  }
}
{
  "url": "<url to crawl>",
   "scrapeOptions": {
    "includeTags": ["#readable"]
  }
}

Did you find this page helpful?