408 fixed

hey guys we are getting request timeout now when scraping, return status 408
20 Replies
Adobe.Flash
Adobe.Flash11mo ago
Hey @kenrazo we pushed a fix for it this morning. Sorry about that! Should be all good now
kenrazo
kenrazoOP11mo ago
Hey guys may I know why its happen? Thank you
kenrazo
kenrazoOP11mo ago
hey @Adobe.Flash @Caleb we are receiving this error when scraping and it breaks our app. how can we handle this? Thank you
No description
Adobe.Flash
Adobe.Flash11mo ago
Hey @kenrazo just escalated this! Ccing @thomas and @mogery In regards to the 408 the other day, we pushed a big refactor to improve reliability and performance long term, unfortunately there was a tiny bug under heavy load that we didnt catch beforehand, but we promptly fixed it.
thomas
thomas11mo ago
Hey, this should work now. It was related to a short downtime from our proxy provider, we are working on redundancy options and better tracking such issues.
kenrazo
kenrazoOP11mo ago
Thank you! oh but i just received it when the time i sent the message. is it fix then? Thank you FYI guys were getting Critical: {"success":false,"error":"(Internal server error) - All scraping engines failed!"}
mogery
mogery11mo ago
Can you supply a URL where you're getting that please? Or is it across all scrapes?
kenrazo
kenrazoOP11mo ago
its across all scrape. im trying to replicate it thru postman but i cant catch it
kenrazo
kenrazoOP11mo ago
hey guys im still getting this error status code is 200 but this is the response { "success": true, "data": { "markdown": "", "metadata": { "ogLocaleAlternate": [], "sourceURL": "https://bluebungalow.com.au/products/carra-rose-gold-crossover-sandal", "url": "https://bluebungalow.com.au/products/carra-rose-gold-crossover-sandal", "statusCode": 407, "error": "Proxy Authentication Required" } } } I am scraping 50 urls when i got this response
No description
mogery
mogery11mo ago
@thomas AU proxy down again
kenrazo
kenrazoOP11mo ago
Hi team, we are still receiving this. "failed to do request: Get "https://bluebungalow.com.au/products/abby-taupe-leather-slingback-mule\": Proxy responded with non 200 code: 407 Proxy Authentication Required"
Blue Bungalow AU
Abby Taupe Leather Slingback Mule
RUNS SLIGHTLY SMALL: If you are in between sizes, we recommend sizing up FIT: Narrow Elegant and timeless mules in an easy-to-wear slingback design Features straps over the bridge of the foot for style and support Slingback heel strap with an adjustable buckle for fit versatility Padded footbed and slightly raised heel
From An unknown user
From An unknown user
From An unknown user
Adobe.Flash
Adobe.Flash11mo ago
Investigating! @thomas
kenrazo
kenrazoOP11mo ago
Thank you. I also find out sometmes this error message go to Markdown in response
kenrazo
kenrazoOP11mo ago
Hi team, is it down again?
No description
kenrazo
kenrazoOP11mo ago
Hey guys, I dont know if you have an update but this is not working anymore.
No description
kenrazo
kenrazoOP11mo ago
hello @Adobe.Flash , @mogery , @thomas , @Caleb . Please give some update for this one. thank you
thomas
thomas11mo ago
Hey, I am on it will update you today.
kenrazo
kenrazoOP11mo ago
thank you
thomas
thomas11mo ago
@kenrazo fixed it, sorry for taht
kenrazo
kenrazoOP11mo ago
thank you

Did you find this page helpful?