Unexpected error during scrape URL: Status code 429. Rate limit exceeded.
Does anyone else also faces the issue of rate limit exhaustion when trying to scrape from a list of URLs?
Despite being on a standard plan which gives 50 scrapes/minute, I'm facing this issue after scraping of just 5 URLs.
Any thoughts what could be the issue here?
9 Replies
@Caleb , @Adobe.Flash , @rafaelmiller for visibility.
Hi @Sachin is this still happening? Can you dm me your email so we can check your account if so
Yes @Adobe.Flash , still facing the same issue.
Have shared the details in DM.
hey @Sachin, Nick sent me your email. I'm going to take a look on this problem right now.
Hi @rafaelmiller , thanks for the heads up.
Let me know in case you need anything else from my end.
The issue is very peculiar.
Hey @Sachin I've pushed a bug fix, and the rate limits should not occur anymore
Thanks for the update @rafaelmiller. I would be testing for the same in a while. Will keep you posted.
Update - Seems like it's working fine for now.
Thanks for the fix.
Hey there @rafaelmiller !
I'm also getting a similar problem after upgrading my account to the Standard plan.
Looks like I'm still limited by the 10 request/min instead of the 500 requests/min
Wondering if this is a regression or maybe a new issue? Happy to move this conversation elsewhere if appropriate or provide more details.
Having been having the same issue as well on growth plan