Does the Electric Collection wait for up-to-date before emitting data?

I'm using Zod to parse the data that Electric syncs, and my Zod schemas include validation for JSONB columns. After I migrate my JSONB schemas and update values, I know that the shape stream will still contain insert/update messages with the old schemas but eventually resolve to the current value.

Currently, I handle this by buffering inserts/updates/deletes and parsing only after receiving the up-to-date header, which works well. However, I'm now testing Tanstack DB, and my code below is erroring because fn.select seems to run on the intermediate invalid values.

Does every insert/update/delete message trigger updates in the downstream live queries? Is there a way to get the collection to "wait" until it's fully synced? I'm guessing I could exclude rows from

this.raw

this.raw

until safeParse succeeds, but running on values that aren't fully synced seems inefficient.

this.raw = createCollection(
    electricCollectionOptions({
        shapeOptions: { ... }
        schema: TaskSchema,
        getKey: (task) => task.id,
    }),
);

this.rows = createLiveQueryCollection((q) =>
    q
        .from({ task: this.raw })
        .fn.select(({ task }) => TaskSchema.parse(task)),
);

this.raw = createCollection(
    electricCollectionOptions({
        shapeOptions: { ... }
        schema: TaskSchema,
        getKey: (task) => task.id,
    }),
);

this.rows = createLiveQueryCollection((q) =>
    q
        .from({ task: this.raw })
        .fn.select(({ task }) => TaskSchema.parse(task)),
);

TanStack•4mo ago•

15 replies

moderate-tomato

Does the Electric Collection wait for up-to-date before emitting data?

this.raw

this.raw

until safeParse succeeds, but running on values that aren't fully synced seems inefficient.

this.raw = createCollection(
    electricCollectionOptions({
        shapeOptions: { ... }
        schema: TaskSchema,
        getKey: (task) => task.id,
    }),
);

this.rows = createLiveQueryCollection((q) =>
    q
        .from({ task: this.raw })
        .fn.select(({ task }) => TaskSchema.parse(task)),
);

this.raw = createCollection(
    electricCollectionOptions({
        shapeOptions: { ... }
        schema: TaskSchema,
        getKey: (task) => task.id,
    }),
);

this.rows = createLiveQueryCollection((q) =>
    q
        .from({ task: this.raw })
        .fn.select(({ task }) => TaskSchema.parse(task)),
);

Does the Electric Collection wait for up-to-date before emitting data?

Similar Threads

Does the Electric Collection wait for up-to-date before emitting data?

Similar Threads

Similar Threads

Similar Threads