how do I work with very large collections
Many of the types of data I want to use this for are so large, that they could and should never be loaded entirely on the frontend.
I already have server-side filtering and am wondering how to best convert this to tanstack db.
I don't really have any idea how to start on that.
- Do I load only a subset of data, then do client side filtering and have a "load more" button? That seems awful cause it likely hides data from the user
- Do I do a hbrid where I do client side filtering but then load more data that matches the filter async?
- Do I just load gigabytes worth of data?
I guess these are not necessarily tanstack specific, but I'm new to local-first/sync engines etc
I already have server-side filtering and am wondering how to best convert this to tanstack db.
I don't really have any idea how to start on that.
- Do I load only a subset of data, then do client side filtering and have a "load more" button? That seems awful cause it likely hides data from the user
- Do I do a hbrid where I do client side filtering but then load more data that matches the filter async?
- Do I just load gigabytes worth of data?
I guess these are not necessarily tanstack specific, but I'm new to local-first/sync engines etc
