push data to S3
is there any already built solution to push data straight to an online storage like S3 from crawlee ?
1 Reply
There is no build-in intergration for that, but the are libraries ( https://docs.aws.amazon.com/sdk-for-javascript/v2/developer-guide/s3-node-examples.html ) that are pretty straightforward, and allows you to upload the data with just few lines of code.
Amazon S3 Node.js Examples - AWS SDK for JavaScript
The following topics show examples of how the AWS SDK for JavaScript can be used to interact with Amazon S3 buckets using Node.js.