How to predict required memory for calling an actor from self-created actor (externally)?
Hi, I got a few questions regarding: https://apify.com/maxcopell/zillow-api-scraper
1. When I run this actor directly, I get no issues, but when I run the same with own actor calling this actor, I get the issues of exceeding memory (see picture with logs). Is there a difference and will upgrading to pro be sufficient?
2. I am paying about 0.2$ per request (when I scrape only 3 results) is there a way to lower this (like no pictures or html only with Cheerio?)
3. "The average cost of using the Zillow Scraper is about $0.25 for every 2,000 results scraped." This does not match what I get, which is around 0.2$ per call, returning 3 results per call max.
Apify
Scrape Zillow real estate listings 🏘️ · Apify
Our free Zillow scraper lets you extract data about properties for sale and rent on Zillow using the Zillow API, but with no daily call limits. Scrape millions of listings and download your data as HTML, JSON, CSV, Excel, XML, and RSS feed.
6 Replies
conscious-sapphire•3y ago
Hi @Walt,
1. This is because of the account memory limit. Upgrading the plan would solve your issue. We are also looking at increasing the limit for the free plan but not sure if/when this will happen.
2. Zillow needs to do some initial requests, so if you scrape only few properties this might inflate the price.
3. Zillow keeps improving the anti-scraping protection, so it is possible that the price is now higher.
We are also working on rewriting of some flows into smaller actors, specifically,
zip code + search filters -> list of property urls and then property url -> scrape details but we are not sure when this will be ready.There are different channels for Apify and Crawlee.
Let's keep them separated.
extended-salmonOP•3y ago
apologies, would you like me to stop talking here and open a new chat elsewhere?
thanks for the reply, is there a place to stay posted on updates (regarding this actor)?
Furthermore I do not understand how to search for multiple locations: "search": "los angeles ca, \nmanhattan new york ny"
-> yielded me only the new york
ambitious-aqua•3y ago
I guess, scraper can't process multiple locations at a time.
One run = one location.
Also, "Changelogs" tab should be added soon to the Apify platform (implementation is in process currently). So you will be able to see updates.
extended-salmonOP•3y ago
Ah I didn't expect that option. Thanks for support.
@Walt just advanced to level 1! Thanks for your contributions! 🎉