Cloudflare Developers•9mo ago•

76 replies

Whats your use case? Bit more context?

1984 Ford LaserOP•4/10/25, 4:55 AM

@gruntlord6 jump in here, so arent spamming

gruntlord6•4/10/25, 4:55 AM

right, but now I am thinking of a bigger workflow where I spin sub objects to do a task

gruntlord6•4/10/25, 4:56 AM

and do seems easier to do that with then regular workers

gruntlord6•4/10/25, 4:56 AM

which I guess is why workflows is a product

1984 Ford LaserOP•4/10/25, 4:56 AM

yeah

1984 Ford LaserOP•4/10/25, 4:56 AM

Workflows is built on DOs

gruntlord6•4/10/25, 4:56 AM

so is everything apprently

1984 Ford LaserOP•4/10/25, 4:56 AM

Does your app have like users

1984 Ford LaserOP•4/10/25, 4:57 AM

Or something else that is an object defined within your backend

gruntlord6•4/10/25, 4:57 AM

this one doesnt, but being single threaded makes it a bit slower

1984 Ford LaserOP•4/10/25, 4:57 AM

like how are you categorising your data

1984 Ford LaserOP•4/10/25, 4:57 AM

For my use case its streams of sports games

1984 Ford LaserOP•4/10/25, 4:57 AM

so each DO instance is a single match

1984 Ford LaserOP•4/10/25, 4:57 AM

with things like scehdule, scores, players etc

1984 Ford LaserOP•4/10/25, 4:58 AM

using an ID to call each match's DO

1984 Ford LaserOP•4/10/25, 4:58 AM

from the matches namespace

gruntlord6•4/10/25, 4:58 AM

theres a list it has of named data sets, it gets each individual data set then pools it together and sends some formatted data to r2, then packaged everything from the local sql storage to d1

1984 Ford LaserOP•4/10/25, 4:58 AM

If each dataset follows a similar format them maybe a DO per dataset?

1984 Ford LaserOP•4/10/25, 4:58 AM

How big is each dataset

gruntlord6•4/10/25, 4:59 AM

it works fine now but one of the lists is 189 sets so takes a while in the current setup, was considering having a parent process just spin a DO for each set, then having the aprent consolidate

1984 Ford LaserOP•4/10/25, 4:59 AM

yeah

1984 Ford LaserOP•4/10/25, 4:59 AM

I do simuilar

gruntlord6•4/10/25, 4:59 AM

they vary a lot

1984 Ford LaserOP•4/10/25, 4:59 AM

I have another namespace for each league

1984 Ford LaserOP•4/10/25, 4:59 AM

which contains a list of IDs which are references to the match DO

gruntlord6•4/10/25, 4:59 AM

I did it for a different data category and it was way smaller, only 90 lists

1984 Ford LaserOP•4/10/25, 5:00 AM

or could have KV that stores a parent reference to the dataset IDs

gruntlord6•4/10/25, 5:00 AM

theres a seperate product I have put off working on where I want a master data set and each user gets a dedicated database for thier data

gruntlord6•4/10/25, 5:01 AM

I was even thinking crazy, that each object could be its own DO since they tend to contain a huge amount of product data and meta data, which would be part of the customer DO which belongs to the single parent DO that orchestrates the whole rabbit hole

gruntlord6•4/10/25, 5:02 AM

but I figure this would be an easier starting point then that mess

gruntlord6•4/10/25, 5:03 AM

this one I already made was actually large enough that I ran out of memory dumping to R2 and had to reprogram that part

Ggruntlord6 I was even thinking crazy, that each object could be its own DO since they tend ...

1984 Ford LaserOP•4/10/25, 5:12 AM

This is the perfect way to split them up

1984 Ford LaserOP•4/10/25, 5:12 AM

Like essentially as expected

gruntlord6•4/10/25, 5:13 AM

just seems a bit over the top, but I also read the web sockets thing and figured that each DO could be updated in real time if users were changing the data

gruntlord6•4/10/25, 5:13 AM

so I can make this pretty complex vs what my original plan was, just 1 db per user

Ggruntlord6 just seems a bit over the top, but I also read the web sockets thing and figured...

1984 Ford LaserOP•4/10/25, 5:14 AM

Yeah youre thinking in DO terms now lol

gruntlord6•4/10/25, 5:14 AM

which is still pretty solid and probably fine for what most people would do, but I figure may be worth the extra work

1984 Ford LaserOP•4/10/25, 5:14 AM

This is all standard procedure

gruntlord6•4/10/25, 5:14 AM

idk seems like a lot haha

1984 Ford LaserOP•4/10/25, 5:14 AM

So much flexibility though

gruntlord6•4/10/25, 5:15 AM

these cloudflare guys just try to tempt me with all these fancy use cases

1984 Ford LaserOP•4/10/25, 5:16 AM

man I dont have enough time to write all the things I want in DOs

gruntlord6•4/10/25, 5:17 AM

well I guess I'll try this crazy concurrency thing tomorrow and see how 189 instances of storing this data works out lol

1984 Ford LaserOP•4/10/25, 5:18 AM

I do similar with sets of 80-120 instances at a time. Have like 25 sets like that

gruntlord6•4/10/25, 5:18 AM

if that goes well I'll consider trying to make my complicated database plan

1984 Ford LaserOP•4/10/25, 5:18 AM

My main update code through these is super inefficient cos I do a bunch of heavy work in DO instead of in the calling worker

11984 Ford Laser I do similar with sets of 80-120 instances at a time. Have like 25 sets like tha...

gruntlord6•4/10/25, 5:19 AM

well the worse part is I probably have like 10 or so more lists of data sets to architect and they run daily

gruntlord6•4/10/25, 5:19 AM

these were just the most important ones

1984 Ford LaserOP•4/10/25, 5:19 AM

You could do reads of the written data in DO, then compare values to what you are updating with

1984 Ford LaserOP•4/10/25, 5:20 AM

Only update whats necessary maybe

Whats your use case? Bit more context?

Similar Threads

Similar Threads

Similar Threads