memo23
CACrawlee & Apify
•Created by memo23 on 2/20/2025 in #apify-platform
Use an HTTPS agent to enforce TLS 1.3 in got-scraping/CheerioCrawler
Is there a way to change tls version when scraping with CheerioCrawler?
3 replies
CACrawlee & Apify
•Created by memo23 on 5/18/2024 in #apify-platform
File size upload to KeyValueStore
I created actor which downloads and uploads videos to KeyValueStore, some of videos are pretty big and getting this error:
2024-05-18T15:54:15.572Z Failed to upload video: RangeError [ERR_FS_FILE_TOO_LARGE]: File size (2183982088) is greater than 2 GiB
so anyway to get around this and what are best practices on apify for downloading and uploading of big files
2 replies
CACrawlee & Apify
•Created by memo23 on 3/14/2024 in #apify-platform
Docker DNS Mapping Deployment
Hi, so I have a scraping actor that needs to fetch data from 'example.com', but it points to 123.123.123.123 instead, usually I add ip and domain in /etc/hosts file locally, how can I can achieve this via Docker or some other means in my Apify actors(Puppeteer)?
10 replies