Disable persistant storage

Hi guys, I plan to deploy my crawler (a ParselCrawler one) to AWS Lambda. I'm loosely following this guide which is for JavaScript though. I'd like disable persising the storage. I change the configuration like this:
config = Configuration.get_global_configuration()
config.persist_storage = False
config = Configuration.get_global_configuration()
config.persist_storage = False
and also tried to supply the configuration to the ParselCrawler constructor, neither of these works though. I'm still getting the storage directory created. Am I doing something wrong here? Thanks
2 Replies
Hall
Hall8mo ago
View post on community site
This post has been pushed to the community knowledgebase. Any replies in this thread will be synced to the community site.
Apify Community
conscious-sapphire
conscious-sapphire8mo ago
cc @Vlada Dusek 🙏

Did you find this page helpful?