Help! Half or our scrape is getting failed.
We are scraping thousands of product pages and half of our scrape is getting this error. "Specified URL is failing to load in the browser. Error code: ERR_TUNNEL_CONNECTION_FAILED"
I checked the activity logs and i see its failed. you can check the screenshot.
Please help us. thank you
7 Replies
@kenrazo I think you need to check the proxy settings again.
hey @Crown sorry for the late reply, what do you mean to check the proxy settings? We are using "geolocation":{"country":"au"}, for proxy i think. do i need to do something? Thank you
I believe we were just chatting over a support ticket, but I'd recommend removing geolocation, and setting proxy to
auto.@kenrazo plz accept my DM. we can check more.
sorry i just saw ur message. accepted now thank you
oh yes, im just worried if i removed the geolocation we are going to encounter the bug last time that its scraping US site and not the AU.
I doubt it! I believe at that point we didn't have proper AU proxies, but now we should always use AU proxies when scraping that .au site
Hey there,
It's been a while since we've last heard from you, so we are going to go ahead and close out this ticket.
Feel free to open a new one, as needed!