the math aint mathing

Aajgeiss0702 the math aint mathing

H

Hello, I’m Allie!•12/29/24, 6:29 AM

That might be because the system that powers account-level analytics may be a bit behind the actual values

HHello, I’m Allie!That might be because the system that powers account-level analytics may be a bi...

A

ajgeiss0702OP•12/29/24, 6:29 AM

if thats the case, then that would be like a year behind

Aajgeiss0702 if thats the case, then that would be like a year behind

H

Hello, I’m Allie!•12/29/24, 6:30 AM

Weird

A

ajgeiss0702OP•12/29/24, 6:31 AM

that 3gb db has been well past that size for a loooong time

A

ajgeiss0702OP•12/29/24, 6:32 AM

not the end of the world, but a bit odd

A

Amodeus R.•12/29/24, 12:24 PM

Is it possible to use a backend framework like fastify in a wrangler/d1 project? And what about postgres to make queries?

K

kamama•12/29/24, 2:18 PM

I’m encountering D1 slow response, like 500ms+, but my table only have 10 rows, the database is under APAC region. Is that expected?

K

kamama•12/29/24, 2:18 PM

Request without D1 fetch, around 30ms. With D1 fetch around 600ms

W

Walshy•12/29/24, 2:19 PM

Where is your worker invoked?

W

Walshy•12/29/24, 2:19 PM

And are you using smart placement?

WWalshy Where is your worker invoked?

K

kamama•12/29/24, 2:22 PM

Also under APAC

K

kamama•12/29/24, 2:23 PM

default placement

Original message was deleted

I

Igal•12/29/24, 10:33 PM

Lighter Prisma is in the works.
The Kysely gap you described is solvable today-ish with plugins, and possibly in the future with some new APIs (but without turning the library into yet another ORM.)

K

kamama•12/30/24, 1:28 AM

Also when I create D1, if I don’t specific region, it will create in North America, but it’s obviously far away from APAC. Is this recommended?

F

fernvenue•12/31/24, 5:12 AM

Hello everyone, does D1 have a boolean value? If not, what are the best practices for implementing boolean values on D1?

F

fernvenue•12/31/24, 5:13 AM

F

fernvenue•12/31/24, 5:14 AM

Ah, got it.

A

Astral•12/31/24, 2:39 PM

Hey all

I'm a massive Cloudflare advocate in my big organization, and we use it heavily. So far we haven't been using D1 as we have no need. But I've started using it on a side passion project of my own.
So far everything works how I would like it, except that the Response time for basically any query (even the most simple ones) are very high.

I have a worker which serves as my API layer, and it calls the D1 internally. Every request takes over 2-3 sec to respond.

What is your experience with D1 response times?

Also to mention, the DB is very small ~12kb in total.

J

James•12/31/24, 2:42 PM

That seems to align with what others are reporting, depending on network latency, types of queries, db location, etc. I would be wary of using D1 in production though until there's some more guidance around error rates and types of errors, since they do seem to happen more than would be reasonably expected: https://github.com/cloudflare/cloudflare-docs/issues/18485

JJames That seems to align with what others are reporting, depending on network latency...

A

Astral•12/31/24, 2:44 PM

Interesting. I've just joined Disc here, and I'm reading through history, where I'm seeing people having the same problem I'm having.
@James do you have some recommendation on what works well as a simple DB together with Workers?

J

James•12/31/24, 2:45 PM

I'd go with Postgres via https://neon.tech/ if you want something more featured than SQLite - you can pair it with Hyperdrive for some impressive latency/query times, or https://turso.tech/ if you want SQLite which I've heard good things about

JJames I'd go with Postgres via https://neon.tech/ if you want something more featured ...

A

Astral•12/31/24, 2:47 PM

Ok great, I will try it out. I might go with SQLite first as I've already built most of the queries/seeds etc. And I really need the most basic of stuff.
I appreciate the recommendations.

G

Gagan Suie•12/31/24, 11:41 PM

anyone using raw sql? or everyone using an ORM like drizzle? just curious.

GGagan Suie anyone using raw sql? or everyone using an ORM like drizzle? just curious. 🤔

I

Isaac McFadyen•1/1/25, 3:42 AM

I previously used raw SQL and I moved to Drizzle. I still try to use Drizzle as close to raw SQL as I can (I use the query builder not their

db.query

db.query

db.query

db.query wrapper) but IMO it's very handy to be able to construct SQL with standard JS/TS functions rather than string interpolation.

W

Walshy•1/1/25, 3:44 AM

Drizzle's functions are fine for simple queries. Any more advanced and they're messy and limited

W

Walshy•1/1/25, 3:45 AM

Luckily most queries usually are simple

P

progame•1/1/25, 3:48 AM

does D1 have "varbinary"? also where can i find a list of all the types?

W

Walshy•1/1/25, 3:50 AM

https://www.sqlite.org/datatype3.html

WWalshy Luckily most queries usually are simple

I

Isaac McFadyen•1/1/25, 4:00 AM

Yeah and then you can use the raw API for anything that doesn't fit in the simple query builder pattern.

I

Isaac McFadyen•1/1/25, 4:01 AM

Or just use the driver directly I guess :lul:

GGagan Suie anyone using raw sql? or everyone using an ORM like drizzle? just curious. 🤔

J

James•1/1/25, 6:28 AM

Raw sql for db usage, drizzle kit for migrations.

G

Gagan Suie•1/1/25, 6:32 AM

I'm just glad I'm not the only one that prefers raw sql.

K

kamama•1/1/25, 9:44 AM

I’m encountering very slow query issue, any way to check why? Already enabled smart place worker

K

kamama•1/1/25, 9:44 AM

query is simple and datasets are small

G

Gagan Suie•1/1/25, 10:19 AM

does CAST work in d1 queries?

Kkamama I’m encountering very slow query issue, any way to check why? Already enabled sm...

A

Astral•1/1/25, 11:44 AM

@kamama I've reported the same issue yesterday. I guess it's how it is. Maybe it's the free plan.
I've dabbled in trying out different cloud DB solutions as suggested by other members here.
But I've haven't found anything I super like.
I'm gonna continue with D1, and it's slow response times - which I will try to mitigate with the CacheAPI.

AAstral @kamama I've reported the same issue yesterday. I guess it's how it is. Maybe it...

K

kamama•1/1/25, 11:51 AM

If it’s because of free to make the performance poor, I can understand that, but at least let us know. Just worry after paid, the performance is still poor

K

kamama•1/1/25, 12:11 PM

Seems it’s better move to Turso until the issue fixed by Cloudflare team

G

Gagan Suie•1/1/25, 9:55 PM

is there any way to view indexes in D1 dashboard?

L

Larry•1/2/25, 2:15 AM

I don't think there is any intention to increase the overall 10GB limit

T

tcarson•1/2/25, 3:36 AM

Bummer right

K

kamama•1/2/25, 11:05 AM

1 query take 224ms (foods_aus raw) and another one take 1.1s (nutrients_aus raw), both enable smart place and under same region

K

kamama•1/2/25, 11:05 AM

how come it have 5x diff..

K

kamama•1/2/25, 11:08 AM

both records < 10k rows

Kkamama 1 query take 224ms (foods_aus raw) and another one take 1.1s (nutrients_aus raw)...

M

Max (@rozenmd)•1/2/25, 11:55 AM

compare the query

rows_read

rows_read

rows_read

rows_read vs how many rows you get back (or take a look at

wrangler d1 insights

wrangler d1 insights

wrangler d1 insights

wrangler d1 insights and look for query efficiency) - chances are you're missing an index

K

kamama•1/2/25, 11:57 AM

{
    "query": "select \"id\", \"food_id\", \"nutrient_id\", \"amount\", \"derivation_id\", \"created_at\", \"updated_at\", ? || \"_\" || \"food_id\" as \"foodId\" from \"food_nutrients\" \"foodNutrients\" where \"foodNutrients\".\"food_id\" in (?, ?, ?, ?)",
    "avgRowsRead": 252,
    "totalRowsRead": 504,
    "avgRowsWritten": 0,
    "totalRowsWritten": 0,
    "avgDurationMs": 1.75905,
    "totalDurationMs": 3.5181,
    "numberOfTimesRun": 2,
    "queryEfficiency": 0.9682539682539683
  }

{
    "query": "select \"id\", \"food_id\", \"nutrient_id\", \"amount\", \"derivation_id\", \"created_at\", \"updated_at\", ? || \"_\" || \"food_id\" as \"foodId\" from \"food_nutrients\" \"foodNutrients\" where \"foodNutrients\".\"food_id\" in (?, ?, ?, ?)",
    "avgRowsRead": 252,
    "totalRowsRead": 504,
    "avgRowsWritten": 0,
    "totalRowsWritten": 0,
    "avgDurationMs": 1.75905,
    "totalDurationMs": 3.5181,
    "numberOfTimesRun": 2,
    "queryEfficiency": 0.9682539682539683
  }

{
    "query": "select \"id\", \"food_id\", \"nutrient_id\", \"amount\", \"derivation_id\", \"created_at\", \"updated_at\", ? || \"_\" || \"food_id\" as \"foodId\" from \"food_nutrients\" \"foodNutrients\" where \"foodNutrients\".\"food_id\" in (?, ?, ?, ?)",
    "avgRowsRead": 252,
    "totalRowsRead": 504,
    "avgRowsWritten": 0,
    "totalRowsWritten": 0,
    "avgDurationMs": 1.75905,
    "totalDurationMs": 3.5181,
    "numberOfTimesRun": 2,
    "queryEfficiency": 0.9682539682539683
  }

{
    "query": "select \"id\", \"food_id\", \"nutrient_id\", \"amount\", \"derivation_id\", \"created_at\", \"updated_at\", ? || \"_\" || \"food_id\" as \"foodId\" from \"food_nutrients\" \"foodNutrients\" where \"foodNutrients\".\"food_id\" in (?, ?, ?, ?)",
    "avgRowsRead": 252,
    "totalRowsRead": 504,
    "avgRowsWritten": 0,
    "totalRowsWritten": 0,
    "avgDurationMs": 1.75905,
    "totalDurationMs": 3.5181,
    "numberOfTimesRun": 2,
    "queryEfficiency": 0.9682539682539683
  }

i think most of the time consume is on network layer

0

0x3lang•1/2/25, 4:49 PM

anynone can help me? my d1 database stuck: D1 DB is overloaded. Requests queued for too long

0

0x3lang•1/2/25, 4:49 PM

00x3lang anynone can help me? my d1 database stuck: D1 DB is overloaded. Requests queued...

J

James•1/2/25, 5:01 PM

What's your database ID and we can escalate this?

Similar Threads

Similar Threads

Similar Threads