HI everyone,

HI everyone,

is it possible to mix a durableObject to have Sqllite and also key value?
i have some structured data that i want to save and avoid recalculating, the issue that if i use tabular structure its take for ever to save to sqlite, and if i use a json its failing cause this json is too big.
what is the best practice here?

Lulu•11/7/25, 7:32 AM

have you looked into R2 Data Catalog? it might or might not fit your use case depending on how often you query the data

TunaOP•11/7/25, 7:33 AM

i need it in a durableObject since i need fast retrival

Lulu•11/7/25, 7:35 AM

i see. i don't remember seeing anything that says you can't have both in the same DO, but im not sure if the performance would improve since KV is implemented using a SQLite database under the hood

Jacob Marshall•11/7/25, 8:05 AM

SQLite Durable Objects have a KV API too. It’s just backed by the SQLite DB.

Jacob Marshall•11/7/25, 8:06 AM

https://developers.cloudflare.com/durable-objects/api/sqlite-storage-api/#synchronous-kv-api

Cloudflare Docs

SQLite-backed Durable Object Storage

The Durable Object Storage API allows Durable Objects to access transactional and strongly consistent storage. A Durable Object's attached storage is private to its unique instance and cannot be accessed by other objects.

TunaOP•11/7/25, 8:56 AM

if i want to insert lots of record, its slow, and i also tried batch operation, and json have its limitation, kv is loaded to memory and its peresisted.

Larry•11/7/25, 9:40 AM

If it's too big to use JSON in SQLite, it may be too big to stick it in DO storage KV. Maybe not, because I suspect that DO storage KV uses Cap'n Proto serialization which is more efficient, but it's like 2x max more efficient, not 10x.

Can you do things incrementally and only do partial updates?

lambrospetrou•11/7/25, 10:20 AM

i have some structured data that i want to save and avoid recalculating, the issue that if i use tabular structure its take for ever to save to sqlite, and if i use a json its failing cause this json is too big.

Can you provide some more details on what you want to do exactly? It's not clear what "want to save and avoid recalculating" means, or how big is the JSON leading to failure.

1984 Ford Laser•11/7/25, 10:36 AM

Yeah what is the JSON containing and how large is it?

TunaOP•11/14/25, 11:34 PM

it was a manifest file, its was over 34 mib, i moved to protobuff and spreaded to key value and used list and get bulk and now its wokring fine, thanks

HI everyone,

Similar Threads

Similar Threads

Similar Threads