Cloudflare Developers•3y ago

If you hit one of those limits, it would result in an error - not a hanging promise.

divby0•11/26/23, 1:27 PM

could this be that drizzle swallows the error maybe?

Kkian If you hit one of those limits, it would result in an error - not a hanging prom...

divby0•11/26/23, 1:32 PM

Also would it be expected for inserting 17 items with 6 columns to not work?

Ddivby0 Changing from wrangler v2 to v3, I experience the inability to insert as many va...

Matt Silverlock•11/26/23, 1:45 PM

Are you running locally?

MMatt Silverlock Are you running locally?

divby0•11/26/23, 1:52 PM

Yes correct

divby0•11/26/23, 2:03 PM

Wrangler v2 was able to run locally as well as on the actual remote worker with more than 16 elements . Easily 50.

I also didn't upgrade the database to the new one yet (or migrate) because of the expression depth problem. I was just grading up wrangler v3 to test out th eexpression depth which now seems to be sufficient

Ccardyet Does anyone know about read-replication. I'm in Lima, Peru and I have pocketbase...

Cyb3r-Jak3•11/26/23, 3:00 PM

Planned for GA but doesn't exist yet

Epailes•11/26/23, 4:28 PM

On the topic of read replication:
Is it known if replicas will be automatically distributed to major cloudflare locales? Or will it be a similar behaviour to cloudflare cache (how frequently is the resource requested? How large is it? How busy is the target locale?) and potentially be in the smalled edge locales?
I'm planning on switching to D1 once it reaches GA, and curious whether it's worth planning to share D1 instances per tenant as that means each instance is more likely to be cached? Or whether that won't have any major impact? Each of my tenants don't use up much data, <10MB.

Ccardyet Does anyone know about read-replication. I'm in Lima, Peru and I have pocketbase...

johnswarbrick•11/26/23, 8:22 PM

114ms is nice. Getting around 250ms for simple SELECT queries on an almost empty DB from here in the UK. Looking forward to the read-replica replication to see whether D1 is a really a viable, super-scaleable alternative to other cloud database providers.

schwartzmj•11/26/23, 10:00 PM

Anyone know if it's possible to run wrangler d1 migrations applywrangler d1 migrations apply during the Cloudflare Pages build step? And if so how to specify the database name at the end of the command dynamically based on a

.env

.env

or some binding

SSuchACharles Running Nextjs 14 edge pages to display data from D1, it works, however, after a...

Matt Silverlock•11/27/23, 12:03 AM

wrangler dev

wrangler dev

is local by default, so you aren’t seeing the local development changes reflected in your “global” D1 database

Jjohnswarbrick 114ms is nice. Getting around 250ms for simple SELECT queries on an almost empty...

Rob M.•11/27/23, 12:06 AM

250ms from the API or worker?

kianOP•11/27/23, 12:18 AM

What is your Worker's code?

kianOP•11/27/23, 12:23 AM

Yep!

kianOP•11/27/23, 12:25 AM

Have you re-generated the Drizzle schema since adding these new columns?

kianOP•11/27/23, 12:25 AM

Drizzle doesn't use SELECT *SELECT *, it lists all columns from your schema, so it may not be selecting new columns if it hasn't been generated again.

kianOP•11/27/23, 12:40 AM

No problem, glad it's sorted.

Santosh•11/27/23, 4:40 AM

can someone provide an example on this topic: How do I insert and then append a json object (not a scalar,) but a proper json object using json_insert at the end of an existing json array in D1? My objective is to store data like this in one text column: history: [{object1 with key and values}, {object2 with keys and values}]

Elodere•11/27/23, 10:12 AM

Does D1 support UUIDv7 or should I go with ULID for now?

EElodere Does D1 support UUIDv7 or should I go with ULID for now?

Rob M.•11/27/23, 10:29 AM

Why? UUIDv7 is still in a WIP state itself. Is it a game changer?

Elodere•11/27/23, 10:33 AM

UUIDv7 from what I've glanced of the spec is supposed to be a lot better than v6 (generally recommended to use v7 whenever possible basically)

RRob M.Why? UUIDv7 is still in a WIP state itself. Is it a game changer?

Elodere•11/27/23, 10:33 AM

I don't know enough to claim that it's a game changer, but it's definitely a significant improvement over previous versions

Elodere•11/27/23, 10:34 AM

hence why some people are looking at UUIDv7 as a possible replacement for using ULID

EElodere UUIDv7 from what I've glanced of the spec is supposed to be a lot better than v6...

Elodere•11/27/23, 10:44 AM

Also something I've realized is that the dashboard only seems to allow for string, int, blob, and real datatypes

But because D1 runs on SQL, I assume it should be fine to use datatypes like UUID right?

Elodere•11/27/23, 10:46 AM

Thank you I didn't realize it was SQLite

Elodere•11/27/23, 10:47 AM

Yeah then I was right in just using string as the type

EElodere I don't know enough to claim that it's a game changer, but it's definitely a sig...

Rob M.•11/27/23, 10:48 AM

D1 is a game changer dogekek

Elodere•11/27/23, 10:49 AM

Yeah the only thing I'm worried over is that because cloudflare pages is an edge based solution, that I'll have to think of distributed data from the get go

Then again, I did see it mentioned somewhere that D1 is transaction based, so race conditions will thankfully not happen

Stone•11/27/23, 10:49 AM

Does someone know if I use the FTS5 (full text search) extension in D1?

SStone Does someone know if I use the FTS5 (full text search) extension in D1?

Max (@rozenmd)•11/27/23, 11:31 AM

FTS5 is supported, yes

EElodere Yeah the only thing I'm worried over is that because cloudflare pages is an edge...

Max (@rozenmd)•11/27/23, 11:31 AM

Yep, we run every query in a transaction

Stone•11/27/23, 11:35 AM

@rozenmd That is beautiful! Goodbye 3rd party search engines, for small/medium sized data

Rob M.•11/27/23, 12:14 PM

I need to return a response from the worker asap and also run a write query to D1. Is it possible to not wait for the API call or maybe do it after the "return new Response()"? Using Queues is an option but not a desirable one.

RRob M.I need to return a response from the worker asap and also run a write query to D...

Sam•11/27/23, 12:19 PM

https://developers.cloudflare.com/workers/runtime-apis/handlers/fetch/#contextwaituntil

RRob M.250ms from the API or worker?

johnswarbrick•11/27/23, 1:29 PM

250ms is the time taken for the D1 database to respond with results back to my worker. Sometimes dips to 210ms, but it's quite consistent. Really hoping having read-replicas speeds this up.

Jjohnswarbrick 250ms is the time taken for the D1 database to respond with results back to my w...

Max (@rozenmd)•11/27/23, 1:39 PM

Are you using indexes?

Max (@rozenmd)•11/27/23, 1:41 PM

because fetching a specific record in the northwind db takes 0.2ms: https://northwind.d1sql.com/dash

johnswarbrick•11/27/23, 1:50 PM

Yes, I think it's networking latency.

The Cloudflare Worker is being spun up in the UK, because that's the closest CF endpoint.

But then the SQL query is being sent to wherever the D1 core is currently.

So even a trivial 1 row select from a 1 row table takes 200 - 250ms to return.

I've not tested from APAC yet, I guess it will end up 500-750ms from there.

I'm really hoping read-replicas fixes that problem, although I guess writes will still be slow.

Jjohnswarbrick Yes, I think it's networking latency. The Cloudflare Worker is being spun up in...

Matt Silverlock•11/27/23, 1:55 PM

D1 will locate the leader close to where you created it, or if you provide a hint, close to where you request: https://developers.cloudflare.com/d1/learning/data-location/

Jjohnswarbrick Yes, I think it's networking latency. The Cloudflare Worker is being spun up in...

Matt Silverlock•11/27/23, 1:56 PM

You can see where your leader is located with

wrangler d1 info DB_NAME

wrangler d1 info DB_NAME

e.g.

``
➜ npx wrangler@latest d1 info db-enam
┌───────────────────┬──────────────────────────────────────┐
│ ENAM │ c89db32e-83f4-4e62-8cd7-7c8f97659029 │
├───────────────────┼──────────────────────────────────────┤
│ name │ db-enam │
├───────────────────┼──────────────────────────────────────┤
│ created_at │ 2023-06-12T16:52:03.071Z │
├───────────────────┼──────────────────────────────────────┤
│ version │ beta │
├───────────────────┼──────────────────────────────────────┤
│ num_tables │ 8 │
├───────────────────┼──────────────────────────────────────┤
│ running_in_region │ ENAM │
├───────────────────┼──────────────────────────────────────┤
│ database_size │ 1.83 GB │
├───────────────────┼──────────────────────────────────────┤
│ read_queries_24h │ 1,437 │
├───────────────────┼──────────────────────────────────────┤
│ write_queries_24h │ 1,551,235 │
└───────────────────┴──────────────────────────────────────┘
```

If you hit one of those limits, it would result in an error - not a hanging promise.

Similar Threads