Then you aren't using it correctly. The RPS will depend on what work you are doing with each DO. You

Then you aren't using it correctly. The RPS will depend on what work you are doing with each DO. You should be scaling up to many instances if you are overloading, your architecture isn't designed for your use case

11984 Ford Laser Then you aren't using it correctly. The RPS will depend on what work you are doi...

Advany•2/11/25, 10:00 PM

So many read instances and only one write instance right?

1984 Ford LaserOP•2/11/25, 10:02 PM

Not necessarily, DO instances are single threaded. How you use them will depend on what work you are doing, and how the work needs to be distributed. If you are erroring out at 500RPS you are overloading them and should either shard the work out to many instances, or split your architecture in different ways. There are many ways to use DOs, hitting RPS limits is a failure of implementation, not of the platform

1984 Ford LaserOP•2/11/25, 10:06 PM

I think you misunderstand how DOs work a bit,. Each instance is isolated from one another, so having different read instances wouldn't work unless they are reading from a central DB versus the storage attached to the instance

Ggnomesgames If that helps as an example, for my theatre tickets website, I use DO to store t...

1984 Ford LaserOP•2/11/25, 11:08 PM

Example is good. I have a DO per year, a DO per sports league, a DO per sports match, a DO per live stream for each match

1984 Ford LaserOP•2/11/25, 11:09 PM

Different clients access different DOs depending on usage, and other Workers and DOs access these ones as needed

Ggnomesgames If that helps as an example, for my theatre tickets website, I use DO to store t...

lambrospetrou•2/11/25, 11:24 PM

Obviously it depends on your traffic, but this is a classic example of how hot partitions can bring your site down

With a single DO handling the whole show, if you launch tickets for a big show and you get thousands of visitors, then that's not going to work very well.
If the traffic is low or well spread out, then this is very nice and works well, though.

So, tradeoffs.

Mozzy•2/12/25, 12:07 AM

Can I have a DO backed by both SQL and KV?
I want to use KV storage for some data and SQL for other data

MMozzy Can I have a DO backed by both SQL and KV? I want to use KV storage for some dat...

Chaika•2/12/25, 12:11 AM

No, but if you use SQL, the KV APIs still work, same api, and just use a hidden table

DanTheGoodman•2/12/25, 12:13 AM

Can you make it such that tests wipe previous DO storage data locally when starting the test? Or delete on exit?

CChaika No, but if you use SQL, the KV APIs still work, same api, and just use a hidden ...

Mozzy•2/12/25, 12:13 AM

neat

DDanTheGoodman Can you make it such that tests wipe previous DO storage data locally when start...

Burrito•2/12/25, 1:24 AM

If you are using #vitest-integration-beta, there's an isolatedStorageisolatedStorage option, which IIRC is on by default.

BBurrito If you are using #vitest-integration-beta, there's an `isolatedStorage` option, ...

DanTheGoodman•2/12/25, 1:34 AM

maybe not the beta, im def runnign into issues. Also where does it save to so i can delete it?

Burrito•2/12/25, 1:34 AM

Well, that answer is assuming you are using Vitest integration. If you are using something else then I'm not sure.

Llambrospetrou Obviously it depends on your traffic, but this is a classic example of how hot p...

makrdev•2/12/25, 1:05 PM

I was planning to use a single DO per slug to route traffic to different variations but after I saw your comment I’ve realized that its not a good pattern.

How can we architect such a system like this with DOs then?

Mmakrdev I was planning to use a single DO per slug to route traffic to different variati...

lambrospetrou•2/12/25, 1:10 PM

As always it depends on volume. If you have a few hundred requests per second then it should be fine either way.
Once you have thousands per second per DO it's where you need to start sharding more. There is no "general pattern" that works for everywhere. Different scales need different solutions. And obviously complexity scales as well.
I just mentioned that case because for example if something like Prime Video designed 1 DO per show, then at that scale it wouldn't work. If a local radio station did it, probably all is fine.

Llambrospetrou As always it depends on volume. If you have a few hundred requests per second th...

makrdev•2/12/25, 3:26 PM

Gotcha, I think I can start with the basic solution(to avoid pre-mature optimization since 500 rps is good enough for now) and then introduce sharding. Thanks

Mozzy•2/12/25, 3:39 PM

Is there any good way to gain insights into a DO's SQL data through a UI? Kind of like D1 has

MMozzy Is there any good way to gain insights into a DO's SQL data through a UI? Kind o...

Brayden•2/12/25, 6:39 PM

You can check out https://github.com/outerbase/starbasedb which has some prebuilt components that get deployed with the DO including a visual SQL & table editor. You can also connect your DO then to outerbase.com and use the tools there to visualize and modify your data too.

BBrayden You can check out https://github.com/outerbase/starbasedb which has some prebuil...

Mozzy•2/12/25, 7:50 PM

Sounds cool, I'll check it out

BBrayden You can check out https://github.com/outerbase/starbasedb which has some prebuil...

Jehu•2/12/25, 11:06 PM

Does this work with a pre-existing DO?

JJehu Does this work with a pre-existing DO?

Brayden•2/12/25, 11:15 PM

I haven’t tried but I believe you should be able to bind it to an existing DO no problems

Hhalftome I'm trying to use websockets with my DO. In the tutorials it invokes the DO via ...

Hard@Work•2/13/25, 9:51 AM

Nope, at the moment, WebSockets need to be passed via

fetch

fetch

Hhalftome In my use case I have the option of using either websockets or SSE to periodical...

Hard@Work•2/13/25, 10:19 AM

Nope, CPU Time is only when actively processing something. Just keeping a connection open uses no CPU

Hhalftome okay thanks. It will probably have to be backed by some kind of pubsub, and sinc...

Hard@Work•2/13/25, 10:53 AM

Yes, though I'm not entirely sure how Redis handles connections, it might make some traffic, even when not actively sending data

geg•2/13/25, 11:30 AM

ye u need websocket hibernation

geg•2/13/25, 11:31 AM

or make requests on an interval

HHard@Work Nope, CPU Time is only when *actively* processing something. Just keeping a conn...

Larry•2/13/25, 8:36 PM

I thought DOs were charged on clock-time, not CPU time. Regarless, @halftome, SSE is not a good choice. DOs can be stood up and torn down any time. Same applies for Workers/Page . Since the browser can't directly access DO (except through a WebSocket connection that was previously made via a Worker), you would need to keep both hops open continuously. That's inneficient from both a technical as well as financial perspective. As @egg said, you want websocket hibernation.

LLarry I thought DOs were charged on clock-time, not CPU time. Regarless, @halftome, S...

Hello, I’m Allie!•2/13/25, 8:55 PM

At least if I was understanding correctly, they wanted to terminate the SSE connection within a Worker

Hello, I’m Allie!•2/13/25, 8:55 PM

It was just if it was a webSocket that they would choose DOs

Hello, I’m Allie!•2/13/25, 8:55 PM

Might be wrong tho

BBrayden I haven’t tried but I believe you should be able to bind it to an existing DO no...

DiamondDragon•2/14/25, 6:27 AM

i'd be curious to learn more about this as im trying to get up to speed on using DOs, i had a question here before wondering how people are inspecting the data in their DO instances. Signed up for outbase to quickly check out and I see the D1 connections but not finding how to connect to a DO

1984 Ford LaserOP•2/14/25, 8:18 AM

What's the best way to parallelize calls to multiple DO stubs? I want a Worker to iterate over a list of user_iduser_ids and get a stub for each string, and read some data, and collect it together, but want to try and speed that process up as much as possible

11984 Ford Laser What's the best way to parallelize calls to multiple DO stubs? I want a Worker t...

lambrospetrou•2/14/25, 8:37 AM

Do parallel calls without awaiting them and wait at the end or after batches of N. https://www.npmjs.com/package/p-queue/v/6.0.2 is a popular package used for more control ovr the concurrency.

Llambrospetrou Do parallel calls without awaiting them and wait at the end or after batches of ...

1984 Ford LaserOP•2/14/25, 8:38 AM

exactly what I'm looking for thank you

DDiamondDragon i'd be curious to learn more about this as im trying to get up to speed on using...

Brayden•2/14/25, 12:59 PM

You need to bind your existing DO to a StarbaseDB Worker (clone this & update the wrangler.toml to point to your DO and deploy it to CF – https://github.com/outerbase/starbasedb) then you can connect to Outerbase for example with the "Starbase" option. Edit: made this how-to article if it helps https://x.com/BraydenWilmoth/status/1890408856892629313

CChaika No, but if you use SQL, the KV APIs still work, same api, and just use a hidden ...

Matt•2/14/25, 2:22 PM

That's good to know. So by enabling sqlite for the DO it no longer uses the KV and it's all sqlite? So the rules for optimizing KV with in-memory caching and skipping await for puts to rely on the output gate would no longer apply and everything is synchronous? And does usage/pricing switch over to the sqlite?

Matt•2/14/25, 2:31 PM

Well, I guess the read in-memory caching would probably still exist, but can you now use get without await?

MMatt Well, I guess the read in-memory caching would probably still exist, but can you...

lambrospetrou•2/14/25, 3:57 PM

The KV API is the same, so still async and I suggest keep your awaits to get good IDE intellisense, regardless how the underlying storage works.

plgingras88•2/14/25, 7:33 PM

Hey pals, I am new to DO. I have been amazed until now. Quick question : if I delete a DO instance, will it be recreated potentially elsewhere or the location is written in the stone for good ? Thank you !!

Then you aren't using it correctly. The RPS will depend on what work you are doing with each DO. You

Similar Threads

Similar Threads

Similar Threads