Is it possible to stream scraping results as they become available?
I want to scrape a lot of data and don't want to wait for the actor to finish running before being able to use the data
4 Replies
boiling-coffee•2y ago
Hey! I don't think that's currently possible. You can however theoretically create an actor that would periodically query for the items in the dataset once the scraping starts
itchy-amethystOP•2y ago
what does that mean? Is there a way to poll the actor for data while it's running? @lemurio
boiling-coffee•2y ago
itchy-amethystOP•2y ago
thanks