If i make a websocket as a service saas like pusher and host on cloudflare worker and durable object

If i make a websocket as a service saas like pusher and host on cloudflare worker and durable objects

To sell to millions of users, do i need 1 worker? Or each user require separate worker?

Rahul gangotriOP•1/22/25, 7:40 PM

Just curious

RRahul gangotri If i make a websocket as a service saas like pusher and host on cloudflare worke...

geg•1/22/25, 7:44 PM

im doing this with 1 worker

Ggeg im doing this with 1 worker

Rahul gangotriOP•1/22/25, 7:45 PM

How do you handle the storage limit?

Also Do you store on sql based or use normal storage?

RRahul gangotri How do you handle the storage limit? Also Do you store on sql based or use nor...

geg•1/22/25, 7:47 PM

Oh I thought you meant just pushing messages to many users, no storing

geg•1/22/25, 7:48 PM

For that I would store messages in DO and keep them in cache in colocations

Rahul gangotriOP•1/22/25, 7:50 PM

I dont want to store messages, rather i want to store user connections, channel yhey are subscribed to and all

Messages will be send as we get with no storage

geg•1/22/25, 7:52 PM

I currently have a setup where a DO handles as many channels possible and only 1 connection per colocation that pushes the messages to Cache api, then all the listeners are just reading from the cache on an interval

geg•1/22/25, 7:53 PM

actually they first read from a global array and 1 listener per worker isolate fills that array from the cache api

geg•1/22/25, 7:53 PM

so like literally 1 connection per colocation to the DO

Rahul gangotriOP•1/22/25, 7:53 PM

Colocation means?

geg•1/22/25, 7:53 PM

a datacenter

Rahul gangotriOP•1/22/25, 7:54 PM

Are you using worker for platform or normal worker paid plan?

geg•1/22/25, 7:54 PM

im not offering it as service specifically

geg•1/22/25, 7:54 PM

normal workers

Rahul gangotriOP•1/22/25, 7:54 PM

That’s what

Rahul gangotriOP•1/22/25, 7:54 PM

I need to offer as service like ably and pusher

geg•1/22/25, 7:55 PM

i think what i just told you is pretty good step towards it

geg•1/22/25, 7:55 PM

it costs nothing

Rahul gangotriOP•1/22/25, 7:55 PM

So connection will also scale but hibernated

And channel management needs to be done

So i am just curious that how will it work

geg•1/22/25, 7:55 PM

maybe cloudflare will come knocking with too many users

Ggeg maybe cloudflare will come knocking with too many users

Rahul gangotriOP•1/22/25, 7:56 PM

Right, i dont have money to buy enterprise plan tho

Rahul gangotriOP•1/22/25, 8:05 PM

Maybe anyone from cloudflare can help?

RRahul gangotri If i make a websocket as a service saas like pusher and host on cloudflare worke...

kenton•1/22/25, 8:37 PM

If your users upload code to your service and you run the code for them, you need to use Workers for Platforms, otherwise this is insecure. Otherwise, it's up to you.

RRahul gangotri Right, i dont have money to buy enterprise plan tho 😜

kenton•1/22/25, 8:38 PM

for what it's worth, this is a rumor / conspiracy theory. We do not force people to upgrade to enterprise plans just because they "got big" or whatever.

Kkenton for what it's worth, this is a rumor / conspiracy theory. We do not force people...

geg•1/22/25, 8:39 PM

May I ask what you think of my setup I described above? Is it okay to do that to save costs?

Kkenton If your users upload code to your service and you run the code for them, you nee...

Rahul gangotriOP•1/22/25, 8:40 PM

I dont want user to upload their code rather manage channel subscriptions and all myself, just 1 worker be enough? With multiple DO per app for my user?

Rahul gangotriOP•1/22/25, 8:40 PM

Similar to ably or pusher

Ggeg May I ask what you think of my setup I described above? Is it okay to do that to...

kenton•1/22/25, 8:40 PM

it sounds fine to me, if your DO is not getting overloaded

RRahul gangotri I dont want user to upload their code rather manage channel subscriptions and al...

kenton•1/22/25, 8:41 PM

If it it works, it works. I don't know enough details about your app to say if you will have scalability issues or something.

Kkenton it sounds fine to me, if your DO is not getting overloaded

geg•1/22/25, 8:41 PM

Cool!! Yep it definitely doesn't get overloaded this way!

Kkenton If it it works, it works. I don't know enough details about your app to say if y...

Rahul gangotriOP•1/22/25, 8:42 PM

I am telling its a pusher like service saas

Rahul gangotriOP•1/22/25, 8:42 PM

You know pusher right?

kenton•1/22/25, 8:42 PM

I don't

Ggeg Cool!! Yep it definitely doesn't get overloaded this way!

geg•1/22/25, 8:44 PM

It would be super epic if this was a native feature. But this works for now

Kkenton I don't

Rahul gangotriOP•1/22/25, 8:44 PM

Ok no problem, so there is no limit on websocket connection right?

RRahul gangotri Ok no problem, so there is no limit on websocket connection right?

kenton•1/22/25, 8:45 PM

there's just the memory limit and the fact that the DO is single-threaded. Each new connection presumably takes some memory and some CPU time to handle messages, but there's no explciit limit on number of connections.

Rahul gangotriOP•1/22/25, 8:46 PM

Btw here

https://pusher.com/

Pusher | Leader In Realtime Technologies

Simple, scalable and reliable. Hosted realtime APIs loved by developers and trusted by giants. Build live dashboards, notifications, geotracking, chat and more.

Kkenton there's just the memory limit and the fact that the DO is single-threaded. Each ...

Rahul gangotriOP•1/22/25, 8:46 PM

And whats the memory limit?

geg•1/22/25, 8:47 PM

We can read the docs for this!

Rahul gangotriOP•1/22/25, 8:48 PM

No need of alarms or ping pong when hibernation is used

geg•1/22/25, 8:49 PM

I encourage everyone to read docs! We can get more intricate responses from staff this way!

geg•1/22/25, 8:49 PM

That's all, bye

TTyveris Would love a quick sanity check on my planned architecture. Worker + DO w/ WS p...

Rahul gangotriOP•1/22/25, 8:53 PM

As mentioned in docs, You can create as many objects as needed, only limit is on namespaces per account

You can create unlimited durable objects in 1 namespace

Also there is a storage limit in each DO AND ACCOUNT LEVEL BOTH

If i make a websocket as a service saas like pusher and host on cloudflare worker and durable object

Similar Threads

Similar Threads

Similar Threads