Crawl does not work for a specific website, but scrape does
I’m trying to crawl this URL:
https://www.investopedia.com/terms/r/request-for-proposal.asp/
Yes, including the trailing /. The crawl endpoint is returning nothing, while the scrape endpoint retrieves the correct information. Shouldn't both work?
https://www.investopedia.com/terms/r/request-for-proposal.asp/
Yes, including the trailing /. The crawl endpoint is returning nothing, while the scrape endpoint retrieves the correct information. Shouldn't both work?
Investopedia
A request for proposal (RFP) is a project funding announcement posted by a business or organization that invites companies to place bids to complete the project.
