How would I build a crawler that accepts API requests to submit forms for a user?
I'm thinking of putting it in a serverless function, but thinking there's a better way.
6 Replies
@zksoju just advanced to level 1! Thanks for your contributions! 🎉
fascinating-indigoOP•2y ago
Would I create a private actor and then call it?
Hello @zksoju ,
You may run Express.js server inside the Actor with HTTP API and control the crawler from there.
fascinating-indigoOP•2y ago
Currently hosting it on Apify and then calling the actor from my app
I’m running into hcaptcha issues with a site using anti captcha and also slow runtimes do you have any suggestions?
You can still host it on Apify Platform, there is no issue with that.
You may try to scrape the website with using RESIDENTIAL proxies, these use not datacenter IPs so the captcha does not show for them very ofter - depends on the website implementation.
fascinating-indigoOP•2y ago
I’ve been using residential but captcha always shows up no matter what configs I use not sure why
It seems more convenient so I’m willing 🙂