Hi Apify team will make my scraper
Hi Apify team. will make my scraper faster if subscribe to a paid plan? My task is the playwriter crawler to make a simple request. But it takes 1 minute in most cases and rarely takes around 20 seconds.
8 Replies
quickest-silver•2y ago
You could start by increasing run memory. Paid plans gives you more proxies and credits, as well as more avaiable memory, but by itself it would not make your actor run faster..
xenial-black•2y ago
I found pulling docker image takes around 40 seconds. Any suggestion to reduce this time? 2023-08-17T02:38:09.119Z ACTOR: Pulling Docker image from repository.
2023-08-17T02:38:53.485Z ACTOR: Creating Docker container.
quickest-silver•2y ago
Please send the runID, here or DM
xenial-black•2y ago
dXBLLUgfDYwI7y3xaquickest-silver•2y ago
you're using the playwright scraper. The image includes both chrome and firefox executables - so it's the heavies image out of all Apify images. On the other hand - some of your runs spend basically a second pulling the image. That said - this long pulling time is not ideal, but it happens unfortunately. It's rather random - and the runs with 15 second duration is a confirmation. But sadly - you can't really do anything about it.
xenial-black•2y ago
thanks for your help. The pulling time is expected because I need this page's screenshot. Maybe I should switch to a lighter image rather than the playwright scraper.
quickest-silver•2y ago
You could try the puppeteer one - it is a lighter one. It still could have some longer start times, but it should be rather occasional
xenial-black•2y ago
OK, I will try later. Thanks a lot.