Delta Updates(somehow)?
Hi y'all!
I have a dataset of CSV files(some large enough to not fit into memory). I also have a schema set up to insert that data into Cloudflare D1. A fresh copy of this dataset is pulled from an external API once a day, though I do not know whether anything has changed, whether it is only a single file, or even if it is just a single row in a large file that has changed.
Is there some way for me to only push updates for rows/fields that actually need to be changed, minimising the number of operations I need to do against the DB?
I have a dataset of CSV files(some large enough to not fit into memory). I also have a schema set up to insert that data into Cloudflare D1. A fresh copy of this dataset is pulled from an external API once a day, though I do not know whether anything has changed, whether it is only a single file, or even if it is just a single row in a large file that has changed.
Is there some way for me to only push updates for rows/fields that actually need to be changed, minimising the number of operations I need to do against the DB?
