Why there is 403 error after increase actor memory?
I have an actor hosted in Apify which worked well with 1GB memory. There I have scraped 1020 links at a time. There after I needed to decrease time taken for this scrape. Therefore I have increased the actor memory into 8GB. No the actor scrape only around 350 links successfully. Other links have provided attached error in image. I am using shared proxy group which has 27 proxies in the group. What should I do to avoid this?
4 Replies
@Lahiru Gayantha just advanced to level 1! Thanks for your contributions! 🎉
correct-apricotOP•3y ago
Here is the error message
helpful-purple•3y ago
Hi @Lahiru Gayantha, not sure what website you are scraping, but it is possible, that the concurrency was too high for the site. Slowing the actor down by setting a reasonable maxConcurrency value (20-30, depending on the website) should help.
correct-apricotOP•3y ago
Ill check. Thank you very much.