Scrape private website?
Hello Friends! I'm new to Apify and pretty excited about what I've learned so far. One use case I'm not sure of: Can Apify be used to scrape a website that's not on the public internet? Specifically, I want to scrape knowledgebases inside corporations (with their permission). Is there for example some sort of proxy that could be put in place inside the private network that connects with Appify and then scrapes at Apify's direction? Or etc?
1 Reply
other-emerald•2y ago
If the machine you're running the scraper on has access to the private site (e.g. through VPN), it should work like any other website. What error are you getting?