Extraction with search URL plus body
Does Firecrawl currently support the extraction of content that requires attaching a body to the search request?
For example, to get product content from a specific retailer's website, chances are that it is location/store-based.
E.g., I want to extract all the products from the search term 'toilet paper' from Target, the url will be something like https://www.target.com/s?searchTerm=toilet+paper, but the contents that appear are dependent on the location I'm browsing from or a selected store. And this information is not part of the actual URL pasted above, but inside the body.
"toilet paper," : Target
Shop Target for toilet paper, you will love at great low prices. Choose from Same Day Delivery, Drive Up or Order Pickup plus free shipping on orders $35+.
1 Reply
You can choose which country you want Firecrawl to use when scraping the content: https://docs.firecrawl.dev/features/scrape#location-and-language.