i'm running into an issue where users in Hong Kong are getting their DO created in that region, but

i'm running into an issue where users in Hong Kong are getting their DO created in that region, but that means OpenAI API calls

AAvi i'm running into an issue where users in Hong Kong are getting their DO created ...

Chaika•2/11/25, 9:08 PM

hmm that's interesting, maybe just checking if their region is Asia Pacific (and/or colo, but colos can change), and then using a hint to oceanic region rather then apac? APAC has Hong kong as part of it, so have to avoid it entirely

Advany•2/11/25, 9:29 PM

https://x.com/chronark_/status/1889411951601783129

We are using do's a lot and slowly scaling up. 500 rps doesnt seem like a lot.

Is this the maximum rate limit of DO's?

chronark — oss/acc (@chronark_) on X

@advany @MrAhmadAwais @Cloudflare @PlanetScale @DrizzleORM it just adds up

worker invocation: $0.30/mil
do invocation: $0.15/mil
do cputime: hard to predict
do storage read: $0.20/4kb/mil

we also observe durable objects randomly failing at 500+ RPS (on a single DO) with "internal error" or "network error", which isn't super helpful to

•

2/11/25, 8:31 PM

CChaika hmm that's interesting, maybe just checking if their region is Asia Pacific (and...

AviOP•2/11/25, 9:32 PM

idea being that I would look at the CF headers on the initial request and do something like:

if location is hong -> set

locationHint

locationHint

"Oceania"

"Oceania"

AAdvany https://x.com/chronark_/status/1889411951601783129 We are using do's a lot and ...

1984 Ford Laser•2/11/25, 9:36 PM

Then you aren't using it correctly. The RPS will depend on what work you are doing with each DO. You should be scaling up to many instances if you are overloading, your architecture isn't designed for your use case

11984 Ford Laser Then you aren't using it correctly. The RPS will depend on what work you are doi...

Advany•2/11/25, 10:00 PM

So many read instances and only one write instance right?

1984 Ford Laser•2/11/25, 10:02 PM

Not necessarily, DO instances are single threaded. How you use them will depend on what work you are doing, and how the work needs to be distributed. If you are erroring out at 500RPS you are overloading them and should either shard the work out to many instances, or split your architecture in different ways. There are many ways to use DOs, hitting RPS limits is a failure of implementation, not of the platform

1984 Ford Laser•2/11/25, 10:06 PM

I think you misunderstand how DOs work a bit,. Each instance is isolated from one another, so having different read instances wouldn't work unless they are reading from a central DB versus the storage attached to the instance

Ggnomesgames If that helps as an example, for my theatre tickets website, I use DO to store t...

1984 Ford Laser•2/11/25, 11:08 PM

Example is good. I have a DO per year, a DO per sports league, a DO per sports match, a DO per live stream for each match

1984 Ford Laser•2/11/25, 11:09 PM

Different clients access different DOs depending on usage, and other Workers and DOs access these ones as needed

Ggnomesgames If that helps as an example, for my theatre tickets website, I use DO to store t...

lambrospetrou•2/11/25, 11:24 PM

Obviously it depends on your traffic, but this is a classic example of how hot partitions can bring your site down

With a single DO handling the whole show, if you launch tickets for a big show and you get thousands of visitors, then that's not going to work very well.
If the traffic is low or well spread out, then this is very nice and works well, though.

So, tradeoffs.

Mozzy•2/12/25, 12:07 AM

Can I have a DO backed by both SQL and KV?
I want to use KV storage for some data and SQL for other data

MMozzy Can I have a DO backed by both SQL and KV? I want to use KV storage for some dat...

Chaika•2/12/25, 12:11 AM

No, but if you use SQL, the KV APIs still work, same api, and just use a hidden table

DanTheGoodman•2/12/25, 12:13 AM

Can you make it such that tests wipe previous DO storage data locally when starting the test? Or delete on exit?

CChaika No, but if you use SQL, the KV APIs still work, same api, and just use a hidden ...

Mozzy•2/12/25, 12:13 AM

neat

DDanTheGoodman Can you make it such that tests wipe previous DO storage data locally when start...

Burrito•2/12/25, 1:24 AM

If you are using #vitest-integration-beta, there's an

isolatedStorage

isolatedStorage

option, which IIRC is on by default.

BBurrito If you are using #vitest-integration-beta, there's an `isolatedStorage` option, ...

DanTheGoodman•2/12/25, 1:34 AM

maybe not the beta, im def runnign into issues. Also where does it save to so i can delete it?

Burrito•2/12/25, 1:34 AM

Well, that answer is assuming you are using Vitest integration. If you are using something else then I'm not sure.

Llambrospetrou Obviously it depends on your traffic, but this is a classic example of how hot p...

makrdev•2/12/25, 1:05 PM

I was planning to use a single DO per slug to route traffic to different variations but after I saw your comment I’ve realized that its not a good pattern.

How can we architect such a system like this with DOs then?

Mmakrdev I was planning to use a single DO per slug to route traffic to different variati...

lambrospetrou•2/12/25, 1:10 PM

As always it depends on volume. If you have a few hundred requests per second then it should be fine either way.
Once you have thousands per second per DO it's where you need to start sharding more. There is no "general pattern" that works for everywhere. Different scales need different solutions. And obviously complexity scales as well.
I just mentioned that case because for example if something like Prime Video designed 1 DO per show, then at that scale it wouldn't work. If a local radio station did it, probably all is fine.

Llambrospetrou As always it depends on volume. If you have a few hundred requests per second th...

makrdev•2/12/25, 3:26 PM

Gotcha, I think I can start with the basic solution(to avoid pre-mature optimization since 500 rps is good enough for now) and then introduce sharding. Thanks

Mozzy•2/12/25, 3:39 PM

Is there any good way to gain insights into a DO's SQL data through a UI? Kind of like D1 has

MMozzy Is there any good way to gain insights into a DO's SQL data through a UI? Kind o...

Brayden•2/12/25, 6:39 PM

You can check out https://github.com/outerbase/starbasedb which has some prebuilt components that get deployed with the DO including a visual SQL & table editor. You can also connect your DO then to outerbase.com and use the tools there to visualize and modify your data too.

BBrayden You can check out https://github.com/outerbase/starbasedb which has some prebuil...

Mozzy•2/12/25, 7:50 PM

Sounds cool, I'll check it out

BBrayden You can check out https://github.com/outerbase/starbasedb which has some prebuil...

Jehu•2/12/25, 11:06 PM

Does this work with a pre-existing DO?

JJehu Does this work with a pre-existing DO?

Brayden•2/12/25, 11:15 PM

I haven’t tried but I believe you should be able to bind it to an existing DO no problems

Hhalftome I'm trying to use websockets with my DO. In the tutorials it invokes the DO via ...

Hard@Work•2/13/25, 9:51 AM

Nope, at the moment, WebSockets need to be passed via

fetch

fetch

Hhalftome In my use case I have the option of using either websockets or SSE to periodical...

Hard@Work•2/13/25, 10:19 AM

Nope, CPU Time is only when actively processing something. Just keeping a connection open uses no CPU

Hhalftome okay thanks. It will probably have to be backed by some kind of pubsub, and sinc...

Hard@Work•2/13/25, 10:53 AM

Yes, though I'm not entirely sure how Redis handles connections, it might make some traffic, even when not actively sending data

geg•2/13/25, 11:30 AM

ye u need websocket hibernation

geg•2/13/25, 11:31 AM

or make requests on an interval

HHard@Work Nope, CPU Time is only when *actively* processing something. Just keeping a conn...

Larry•2/13/25, 8:36 PM

I thought DOs were charged on clock-time, not CPU time. Regarless, @halftome, SSE is not a good choice. DOs can be stood up and torn down any time. Same applies for Workers/Page . Since the browser can't directly access DO (except through a WebSocket connection that was previously made via a Worker), you would need to keep both hops open continuously. That's inneficient from both a technical as well as financial perspective. As @egg said, you want websocket hibernation.

LLarry I thought DOs were charged on clock-time, not CPU time. Regarless, @halftome, S...

Hello, I’m Allie!•2/13/25, 8:55 PM

At least if I was understanding correctly, they wanted to terminate the SSE connection within a Worker

Hello, I’m Allie!•2/13/25, 8:55 PM

It was just if it was a webSocket that they would choose DOs

Hello, I’m Allie!•2/13/25, 8:55 PM

Might be wrong tho

BBrayden I haven’t tried but I believe you should be able to bind it to an existing DO no...

DiamondDragon•2/14/25, 6:27 AM

i'd be curious to learn more about this as im trying to get up to speed on using DOs, i had a question here before wondering how people are inspecting the data in their DO instances. Signed up for outbase to quickly check out and I see the D1 connections but not finding how to connect to a DO

1984 Ford Laser•2/14/25, 8:18 AM

What's the best way to parallelize calls to multiple DO stubs? I want a Worker to iterate over a list of

user_id

user_id

s and get a stub for each string, and read some data, and collect it together, but want to try and speed that process up as much as possible

11984 Ford Laser What's the best way to parallelize calls to multiple DO stubs? I want a Worker t...

lambrospetrou•2/14/25, 8:37 AM

Do parallel calls without awaiting them and wait at the end or after batches of N. https://www.npmjs.com/package/p-queue/v/6.0.2 is a popular package used for more control ovr the concurrency.

Llambrospetrou Do parallel calls without awaiting them and wait at the end or after batches of ...

1984 Ford Laser•2/14/25, 8:38 AM

exactly what I'm looking for thank you

i'm running into an issue where users in Hong Kong are getting their DO created in that region, but

Similar Threads

Similar Threads

Similar Threads