What Services Should I use?
Hello everyone. I'm looking to build an application that can achieve the following:
Should I use a worker to create an endpoint for ingesting the events?
Then connect the worker to BigQuery? BigQuery only allows 1500 "load jobs" per day so I couldn't insert events 1 by 1. How could I batch and load say every minute?
Or should the worker be bound to D1? R2? (not sure what the major differences are there).
Thank you to anyone with thoughts and ideas
- Receive event data from Shopify's web pixel API (https://shopify.dev/docs/api/web-pixels-api)
- Send the event data to storage (ideally to BigQuery but open to something else)
Should I use a worker to create an endpoint for ingesting the events?
Then connect the worker to BigQuery? BigQuery only allows 1500 "load jobs" per day so I couldn't insert events 1 by 1. How could I batch and load say every minute?
Or should the worker be bound to D1? R2? (not sure what the major differences are there).
Thank you to anyone with thoughts and ideas
