Cloudflare Developers•11mo ago

that means I wont get the benefit of the data replication though 😅

that means I wont get the benefit of the data replication though

IggyOP•2/27/25, 10:04 PM

what's the goal for dynamic relocation?

IIggy that means I wont get the benefit of the data replication though 😅

1984 Ford Laser•2/27/25, 10:08 PM

What data replication? DOs aren't replicated

IggyOP•2/27/25, 10:09 PM

yeah i think i just really misunderstood

IggyOP•2/27/25, 10:09 PM

I was under the assumption that DOs were always executed closest to the user, and sqlite-backed ones have shared data across all of them

1984 Ford Laser•2/27/25, 10:10 PM

Nah every instance is entirely unique to one another. Geolocation isn't a good way to split DOs, doing it per user or account or something is the way to go

IggyOP•2/27/25, 10:11 PM

tl;dr is that i'm trying to build globally distributed ssr, where ssr data resolution is sqlite backed

IggyOP•2/27/25, 10:11 PM

but it sounds like that's not what i'm going to get here?

1984 Ford Laser•2/27/25, 10:12 PM

Nah you will, every user will request their own DO instance versus 1 per geoloc or whatever

IggyOP•2/27/25, 10:12 PM

but "their own DO instance" needs to have sql data already written to it no?

1984 Ford Laser•2/27/25, 10:12 PM

Like for me, my backend is related to sports matches, so I have a DO instance per sports match

IggyOP•2/27/25, 10:12 PM

i think that's my gap

1984 Ford Laser•2/27/25, 10:13 PM

Well yes which you would do upon instantiation, or setup a SQL migrations system

IggyOP•2/27/25, 10:13 PM

but wont the instantiation mean it so the DO is closest to me/the server setting it up?

1984 Ford Laser•2/27/25, 10:13 PM

No because it wont be requested until the user needs it

1984 Ford Laser•2/27/25, 10:14 PM

The constructor isn't called until the DO is requested, which would first be done when a user creates their account

1984 Ford Laser•2/27/25, 10:14 PM

What info does a user need before their account exists?

IggyOP•2/27/25, 10:16 PM

let's say you have a game match w/ id 456. you insert some game stats in to the SQL using a server in IAD. if I were to request /game/456/game/456 in ATL, and you in SEA request /game/456/game/456, doesn't that mean the DO was "initiated" in IAD? so ATL and SEA are both going to IAD?

1984 Ford Laser•2/27/25, 10:16 PM

Yes

IggyOP•2/27/25, 10:16 PM

yeah so the thing I was wanting to do is ATL->ATL, SEA->SEA, etc, all for the same /game/456/game/456

1984 Ford Laser•2/27/25, 10:17 PM

Then just regular Workers with D1 or some other central DB will be the way to go

1984 Ford Laser•2/27/25, 10:17 PM

Your use case doesn't fit the DO design pattern

IggyOP•2/27/25, 10:18 PM

got it got it

IggyOP•2/27/25, 10:18 PM

damn.

IggyOP•2/27/25, 10:19 PM

alright well im glad i was running some numbers, thanks

IggyOP•2/27/25, 10:19 PM

providing a location hint of the dc that will query the do might work

1984 Ford Laser•2/27/25, 10:22 PM

You can provide a location hint when pulling a DO, but it only works for the first time a DO is requested. Some more info about this:
https://developers.cloudflare.com/durable-objects/reference/data-location/#provide-a-location-hint

Cloudflare Docs

Data location · Cloudflare Durable Objects docs

Jurisdictions are used to create Durable Objects that only run and store data within a region to comply with local regulations such as the GDPR or FedRAMP.

IggyOP•2/27/25, 10:22 PM

yeah, >Durable Objects do not currently change locations after they are created1 is the big TIL for me

1984 Ford Laser•2/27/25, 10:27 PM

This note on that page is probably relevant to your use case too, which better explains what I was getting at

IggyOP•2/27/25, 10:28 PM

yeah, i don't see how you can not precreate it prior to the first client if you need to seed it w/ data tho

1984 Ford Laser•2/27/25, 10:47 PM

The data that is needed should be pulled when the user first requests

User requests DO -> check if tables/data exist -> if not, pull/create data

What data do you need to seed to it before creation? You can have another central DB store like KV which is replicated for that use case, pull required data when user needs it

IggyOP•2/27/25, 10:47 PM

CMS data so it's potentially in the 50mb+ of raw data range, which is probably too much to pull for the first user. it would be super cold

1984 Ford Laser•2/27/25, 10:48 PM

CMS data that is unique to that user?

IggyOP•2/27/25, 10:48 PM

it's SSR, so unique to that given domain, not the user requesting the data

1984 Ford Laser•2/27/25, 10:49 PM

Yeah that CMS data should be stored elsewhere

1984 Ford Laser•2/27/25, 10:50 PM

External DB + Hyperdrive in a Worker should get you down to single millisecond query time

IggyOP•2/27/25, 10:51 PM

ty - going to look more in to d1 for my use case instead of needing DOs then

IggyOP•2/27/25, 10:53 PM

actually doesn't look like d1 is what i want either since it's created closest to the original requestor location

AAhmad Awais We have 10Gb of pg data and 10M rows each row we wanna convert each row to a DO....

lambrospetrou•2/28/25, 11:35 AM

We did some rough maths and it’s gonna take 37 days to do so

What is the math you did? We cannot help otherwise.

Acе•2/28/25, 1:09 PM

They must not have heard of asynchronous operations

Aalgads The architecture with DOs lends itself very nicely to creating a distributed sys...

IggyOP•2/28/25, 2:36 PM

Good to know, thanks! Yeah, replication sounds super expensive because you're N-xing everything just to be distributed

Frank•2/28/25, 2:40 PM

when using

wrangler dev --remote

wrangler dev --remote

, DO alarm runs the first time, but if the first run sets another alarm, it doesn't get triggered
is this a known issue

Aalgads Yea, always trade offs though not sure what alternatives you have if you want th...

IggyOP•2/28/25, 3:21 PM

It's way too much data to be able to go to the user's device, it's all about SSR. We need to be able to query the data at-will (SQL/NoSQL) and object storage isn't too terribly great for that. We've looked in to Turso but afaicr you're right about them pivoting a bit. I'll look in to Tigris though