Best Practice to set output data when using named datasets
I've pushed my data to a dataset named, say,
test-dataset. What is the best way here to use this dataset as the output of the actor? I know Actor.pushData would do but that would double the dataset API calls.3 Replies
optimistic-goldOP•3y ago
I'm using JS SDK btw.
@ruyi just advanced to level 1! Thanks for your contributions! 🎉
fascinating-indigo•3y ago
Check the
exportTo options - https://crawlee.dev/api/core/class/Dataset#exportTo - you could basically save the entire dataset to 1 KV store entry or send it directly at the end of the run somehwereDataset | API | Crawlee
The
Dataset class represents a store for structured data where each object stored has the same attributes,
such as online store products or real estate offers. You can imagine it as a table,
where each object is a row and its attributes are columns.
Dataset is an append-only storage - you can only add new records to it but you cannot modify or...