Hello everyone. I'm looking to build an application that can achieve the following: - Receive event data from Shopify's web pixel API (https://shopify.dev/docs/api/web-pixels-api) - Send the event data to storage (ideally to BigQuery but open to something else)
I'm unsure what all the tools I would need for this.
Should I use a worker to create an endpoint for ingesting the events?
Then connect the worker to BigQuery? BigQuery only allows 1500 "load jobs" per day so I couldn't insert events 1 by 1. How could I batch and load say every minute?
Or should the worker be bound to D1? R2? (not sure what the major differences are there).