Duplicate results from multiple runs
Hey,
When I run an actor, I can resurrect it, and I assume there will be no duplicate results.
But when I want to change some settings, it's a new run, it probably re-runs urls I already ran in the previous run.
Is there a way to avoid this? Let's say an actor for businesses (google, yelp, yell etc) runs for London, and i start a new run for a new location or a location within london that might have overlap.
How do I avoid paying again for duplicates? Is there a setting to avoid re-running urls that have already run in a previous runs?
Thanks,
3 Replies
passive-yellow•2y ago
Hello @BOBPG, are you using public actors or your own ones?
optimistic-goldOP•2y ago
Public ones, e.g. the google maps extractor, the yelp extractor etc
passive-yellow•2y ago
Unfortunately, there is no generic solution for this. This would have to be implemented in the Actor itself.
There is this actor: https://apify.com/mnmkng/abort-and-resurrect that allows you to abort, trasnform input and resurrect input of an active run, would this solve your issue? As this changes input on fly, this might lead to unexpected behaviour. Again, depends on th Actor.
Apify
Abort And Resurrect · Apify
Aborts actor runs in bulk and resurrects them with new input and options.