Cloudflare Developers•9mo ago

Next question, when does this come to DO-based SQLite storage?

LLarry Next question, when does this come to DO-based SQLite storage?

lambrospetrou•4/10/25, 1:04 PM

D1 is the customer zero of DOs

So, once we see it's good enough with D1 and iron out some things, DOs will get some version of it too.

LLarry It has happened!!! https://developers.cloudflare.com/changelog/2025-04-10-d1-rea...

lambrospetrou•4/10/25, 1:06 PM

I would encourage people to try this out, and please give us feedback. Tell us cases it broke for you, or didn't do what you expected. Note that it's "beta". We are aware of some specific issues and are fixed as we speak to be rolled out over the next few weeks, so do your own testing to see if fits your workloads too.

cosbgn•4/10/25, 1:08 PM

IMO at least for me the session API adds waaay too much work to bother implement it. Ideally I was hoping cf would just figure this out like turso does

cosbgn•4/10/25, 1:09 PM

Right now I simply use cache & KV which give me pretty much the same results but it's simpler and easier to understand (I know it's eventually consistent, but that works for me)

Ccosbgn Right now I simply use cache & KV which give me pretty much the same results but...

lambrospetrou•4/10/25, 1:11 PM

If you are fine with normal eventual cache, then keep with that, and it fits better. Global consistency has tradeoffs, either exposed to the user and you decide the queries you want consistent, or it's always done implicitly and then you get slower performance across the board.

Ccosbgn IMO at least for me the session API adds waaay too much work to bother implement...

lambrospetrou•4/10/25, 1:11 PM

Which Turso feature specifically? I am aware of the embedded replicas but that's a whole other thing/use-case.

cosbgn•4/10/25, 1:14 PM

They used to have multi region replicas, but from the homepage it looks like they discontinue it

Ccosbgn IMO at least for me the session API adds waaay too much work to bother implement...

LarryOP•4/10/25, 1:19 PM

In what way is it too much work? It looks like it's a few lines of code tweak? That may be more work than continuing to use your own cache+KV solution, but for anyone who hasn't already built that, it seems like adopting the session API is a lot LESS work than building something like you've done.

cosbgn•4/10/25, 1:29 PM

Maybe it's actually very little work, I've just quickly looked at the api, but it seems like I need to read incoming headers, tweak how drizzle interacts with the db, set a new header, etc.

With KV, I just do if (kv) return kn else return d1

The other advantage is that is not vendor lock in, I can switch to any other sqlite provider (like turso) with a single line change

cosbgn•4/10/25, 1:29 PM

but anyways, I wasn't really complaining, I love d1 and cloudflare, was more like my personal feedback

Llambrospetrou D1 is the customer zero of DOs 😼 So, once we see it's good enough with D1 and ...

Burrito•4/10/25, 1:37 PM

Tangentially, hoping for DO dynamic relocation.

BBurrito Tangentially, hoping for DO dynamic relocation.

lambrospetrou•4/10/25, 2:04 PM

You mean relocation of the replicas in other places, or more replicas in specific places, or relocation of the primary?
And do you need it dynamic based on traffic/requests, or you specifying that?

Burrito•4/10/25, 2:05 PM

Relocation of the primary, either manually specify or automatic like worker smart placement.

Burrito•4/10/25, 2:07 PM

Replicas would be nice too but I imagine it would have a similar design to D1 so it would take some effort to make use of it.

ZZack I've not seen any info on that tbh

Isaac McFadyen•4/10/25, 2:29 PM

And here you go Zack, read replicas are here

Isaac McFadyen•4/10/25, 2:29 PM

I was trying to give you a hint the other day without saying anything I wasn't allowed to :lul:

Zack•4/10/25, 2:30 PM

Yea, it makes more sense now, but in a way that's slightly sad because the replicas are just statically placed in all regions rather than dynamically in more places based on load

Zack•4/10/25, 2:30 PM

However, very happy it's here, and sounds like dynamic placement is something they want to bring in the future

ZZack Yea, it makes more sense now, but in a way that's slightly sad because the repli...

Isaac McFadyen•4/10/25, 2:32 PM

Yeessss except:

currently one in each supported D1 region

So right now they're static but they're static in everywhere D1 can even be

Isaac McFadyen•4/10/25, 2:33 PM

If they were dynamic they'd just be dynamic within those same regions.

Zack•4/10/25, 2:33 PM

Yea, I get it

Zack•4/10/25, 2:33 PM

much nicer than having to place them in all regions ourselves, and as I said, improvements will come and will be great to see them!

Wallacy•4/10/25, 2:39 PM

South América is also not invited to the party…. No Replicas here. We all of our D1 calls are router to US.

Chaika•4/10/25, 2:42 PM

Need Durable Objects there first. CF was talking about getting DOs in South America and India, would be nice

lambrospetrou•4/10/25, 2:50 PM

but in a way that's slightly sad because the replicas are just statically placed in all regions rather than dynamically in more places based on load

Smarter placement is on the roadmap

We will iterate on it over the next few weeks/months based on your feedback. Many ideas how to make placement better.

Aajgeiss0702 im personally hoping for some replica news, but we'll see

ajgeiss0702•4/10/25, 3:28 PM

eyyyyy

CChaika Need Durable Objects there first. CF was talking about getting DOs in South Amer...

gruntlord6•4/10/25, 3:50 PM

is there a list of where DO is available?

Ggruntlord6 is there a list of where DO is available?

Chaika•4/10/25, 3:51 PM

broad regions are documented here: https://developers.cloudflare.com/durable-objects/reference/data-location/#supported-locations-1 with ^2 next to not supported currently regions

Cloudflare Docs

Data location · Cloudflare Durable Objects docs

Jurisdictions are used to create Durable Objects that only run and store data within a region to comply with local regulations such as the GDPR or FedRAMP.

Chaika•4/10/25, 3:52 PM

there's a community site for showing where DOs spawn from each cf location/which CF locations support DOs: https://where.durableobjects.live/colo/GRU

Where Durable Objects Live

São Paulo, São Paulo, Brazil (colo)

Tracking where Durable Objects are created, wherever you are in the world.

gruntlord6•4/10/25, 3:54 PM

Thank you

Aalgads Two question about replication - does the storage pricing change at all? Right ...

Milan•4/10/25, 4:12 PM

Not sure about 1, but for your question about replication, yes, there is a cold start for non-active replicas. We only replicate to actively running replicas. If we were always replicating the primary's latest state, then we'd have to keep your replicas hot in memory, in which case you'd be paying for duration, even if you weren't using it.

Aalgads Two question about replication - does the storage pricing change at all? Right ...

lambrospetrou•4/10/25, 4:12 PM

does the storage pricing change at all? Right now I think it's something like .75 per GB. Does that get multiplied by the number of replicas or is the replica pricing baked in?

No! Replicas are not charged extra.

Samantas5855•4/10/25, 4:47 PM

guys, is there something wrong with D1?

Samantas5855•4/10/25, 4:48 PM

My python app that pushes using the api has been getting a lot of

Error inserting data for ant1: 500, {"errors":[{"code":7500,"message":"internal error; reference = e_28XXLS_43d7a89936774b92b106a4e344ee5141"}],"success":false,"messages":[],"result":null}

Error inserting data for ant1: 500, {"errors":[{"code":7500,"message":"internal error; reference = e_28XXLS_43d7a89936774b92b106a4e344ee5141"}],"success":false,"messages":[],"result":null}

SSamantas5855 My python app that pushes using the api has been getting a lot of ```Error inser...

lambrospetrou•4/10/25, 5:12 PM

This was 2 hours ago right? There was a small blip of HTTP errors for a few minutes that is fixed already: https://www.cloudflarestatus.com/incidents/20rzplhpvcsz

Cloudflare D1 Issues

Llambrospetrou This was 2 hours ago right? There was a small blip of HTTP errors for a few minu...

Samantas5855•4/10/25, 5:21 PM

Weird cause Im still having issues

Samantas5855•4/10/25, 5:21 PM

no errors but Im pushing stuff to D1

Samantas5855•4/10/25, 5:21 PM

and my workers pages api still doesnt show them

Samantas5855•4/10/25, 5:22 PM

I can't check the db right now to see if they are there

Samantas5855•4/10/25, 5:22 PM

Are you also Greek?

ajgeiss0702•4/10/25, 6:34 PM

this chart on the blog post gives me the impression that read replicas will pretty much always be under a second behind the primary.
is this impression accurate?

ajgeiss0702•4/10/25, 6:36 PM

also, when the sessions api was announced last year, IIRC it was stated that if you used the old (non-session) D1 api, the behaviour would be the same as it is without replication (always go to the primary) but now this graphic suggests otherwise. did this change?

Aajgeiss0702 also, when the sessions api was announced last year, IIRC it was stated that if ...

Chaika•4/10/25, 6:38 PM

the bottom left of that graphic "With using Sessions api"

ajgeiss0702•4/10/25, 6:38 PM

oh wrong graphic

ajgeiss0702•4/10/25, 6:38 PM

meant this one

ajgeiss0702•4/10/25, 6:40 PM

oh unless this is saying not using the session api (on a replica-enabled db) would be equivalent to using the sessions api with first-primaryfirst-primary?

Aajgeiss0702 oh unless this is saying not using the session api (on a replica-enabled db) wou...

Chaika•4/10/25, 6:43 PM

yea, I don't think the blog does a great job of explaining it, but you can see in the code itself, if just using the methods on the binding itself, it only goes primary
https://github.com/cloudflare/workerd/blob/04deab5ea50818faead9b18ce780d9a55ffccc9a/src/cloudflare/internal/d1-api.ts#L94

Next question, when does this come to DO-based SQLite storage?

Similar Threads

Similar Threads

Similar Threads