CA
continuing-cyan

Scrapy scraper immediately stopped working !!

Hi, I am writing scraper's in Python, Scrapy and Apify. I have multiple actors that were working great till last night but suddenly today when I create a new build and start to run they give error "AttributeError: 'AsyncioSelectorReactor' object has no attribute '_handleSignals'". This is same for all the scrapers if I just run the previous build they run fine. How can I fix this?
3 Replies
yappiest-sapphire
yappiest-sapphire2y ago
Hi @Muhammad Umar , it turns out to be a problem related to the new release of the Twisted library from yesterday (https://github.com/twisted/twisted/releases/tag/twisted-23.8.0), which is a Scrapy requirement. As a hotfix, you can add the following constraint to the requirements.txt of your Actor project:
Twisted < 23.0.0
Twisted < 23.0.0
continuing-cyan
continuing-cyanOP2y ago
Thanks @Vlada Dusek it worked.
yappiest-sapphire
yappiest-sapphire2y ago
Great, you're welcome. Also, we already updated the template (https://github.com/apify/actor-templates/pull/179).

Did you find this page helpful?