Crawlee & Apify•4mo ago

Max session count 1 doesn't work, session got called concurrently upon starting.

7 Replies

exotic-emeraldOP•4mo ago

upon starting the crawler, a single session got called 2 times even with maxUsageCount = 1

exotic-emeraldOP•4mo ago

well even with max concurrency 1, the session get reused on the next request

exotic-emeraldOP•4mo ago

when i explicitly retire the session in preNavHook, the same session still gets called twice

exotic-emeraldOP•4mo ago

https://github.com/apify/crawlee/issues/1836

GitHub

SessionPool generates more sessions that needed and also does not r...

Which package is this bug report for? If unsure which one to select, leave blank None Issue description Create basic PlaywrightCrawler/PuppeteerCrawler/HttpCrawler (at least I've tried all thes...

broad-brown•4mo ago

hey, thanks for reporting. For now, to make it work, you can set maxUsageCount in the createSessionFunction when creating the session

exotic-emeraldOP•4mo ago

i got it working by keeping track of usageCount inside the router handler, the state is stored separately on request.session.userData

Gaming

Programming

Max session count 1 doesn't work, session got called concurrently upon starting.

Did you find this page helpful?