Hi there! Does anybody know how to
Hi there! Does anybody know how to increase HTTPCrawler Requests timeouts? According to the docs there is requestQueue.timeoutSecs property but even when it is set to e.g. 60 secs all my HTTPCrawler requests are failed after 30 sec timeout 😦
2 Replies
ambitious-aqua•12mo ago
I guess you want to set this https://crawlee.dev/api/http-crawler/interface/HttpCrawlerOptions#navigationTimeoutSecs
eastern-cyan•12mo ago
I did it with pre navigation hooks already but this seems to be a bit easier while the name of this param in context of HTTPCrawler is misleading as hell 🙂
thanks for the hint tho