How can I configure PuppeteerCrawler to not save request information to disk?

I see I can set the location of the storage directory with environment variables (CRAWLEE_STORAGE_DIR) , but I am not seeing anything to disable storage. I don't want crawlee to save anything to disk. How can I configure this? Edit: Answering my own post - in the crawlee.json configuration, the storageClientOptions.persistStorage can be set to false to disable crawlee storing on disk
0 Replies
No replies yetBe the first to reply to this messageJoin

Did you find this page helpful?