in order to interact with the local d1 database are you limited to having to rebuild with cloudflare

F

Hey guys, I wonder if using the cloudflare D1 api to execute queries has the same performance than using the d1 binding, I ask that because my application has some logic to use dynamic created databases, having that api would be much appreciated since we don't have support to creating binding dynamically inside the worker

FFalhadoNaMissao Hey guys, I wonder if using the cloudflare D1 api to execute queries has the sam...

B

Beny•4/7/24, 1:17 AM

There is an API rate limit of 1,200 requests per 5 mins for each Cloudflare user (not per account).
If you are on Enterprise plan you can contact Cloudflare for higher limit, otherwise you can make more Cloudflare users to exceed the limit (invite members to your account and make new API keys on those).

FFalhadoNaMissao Hey guys, I wonder if using the cloudflare D1 api to execute queries has the sam...

C

Chaika•4/7/24, 1:20 AM

even besides the rate limit, currently each query via the cf api would have to back to core and then out to the DB, vs the workers bindings being on edge, so in some cases a lot more latency. It's something they're looking into though.
d1-database

B

Beny•4/7/24, 1:27 AM

It also might be impacted by outages such as the one last month when Dashboard + API was down.
They did say back in January that they are designing a way to dynamically access/bind databases.

SSki.oh wait.. does local dev only hit local db?

B

Beny•4/7/24, 4:49 AM

Yes if you're using

wrangler dev

wrangler dev

wrangler dev

wrangler dev it will use a local database.
You can find the local sqlite file under

/.wrangler/state/v3/d1/miniflare-D1DatabaseObject/

/.wrangler/state/v3/d1/miniflare-D1DatabaseObject/

/.wrangler/state/v3/d1/miniflare-D1DatabaseObject/

/.wrangler/state/v3/d1/miniflare-D1DatabaseObject/ folder too if you want to inspect it

S

snacks•4/7/24, 11:39 AM

Hellloo, does anyone have any recommendations for managing migrations between drizzle/prisma and the built in migrations tool? Should I just go with what my ORM provides?

Original message was deleted

S

snacks•4/7/24, 11:56 AM

Thanks! Keen to give D1 a try for this side project, will go with drizzle for this one.

V

villainy•4/7/24, 3:13 PM

https://twitter.com/TablePlus/status/1776611556509253687

TablePlus (@TablePlus) on X

TablePlus will support Cloudflare D1 in the next update!

Twitter

•

4/6/24, 2:02 PM

E

EvanPiro•4/7/24, 3:55 PM

Is there a typescript library out there for building queries? My code has a ton of massive queries as strings and it's getting a bit unweildy.

J

jensen•4/7/24, 3:59 PM

should check https://kysely.dev/ and https://orm.drizzle.team/

I use drizzle

E

EvanPiro•4/7/24, 4:02 PM

how does this compare to knex?

J

jensen•4/7/24, 4:02 PM

it supports TS

J

jensen•4/7/24, 4:02 PM

I haven't used knex i about 5 years though.

E

EvanPiro•4/7/24, 4:04 PM

Does it play well with wrangler migrations? I have a ton.

Screen_Shot_2024-04-07_at_12.04.19_PM.png

E

EvanPiro•4/7/24, 4:17 PM

The most basic thing I'm trying to do is convert this code to drizzle:

      const org: any = await db
        .prepare(
          `
              SELECT o.id, o.name, o.logo_r2_object_id
              FROM account a
              JOIN member m ON a.id = m.account_id
              JOIN organization o ON m.organization_id = o.id
              WHERE a.id = ?
            `
        )
        .bind(user.id) 
        .first();

      const org: any = await db
        .prepare(
          `
              SELECT o.id, o.name, o.logo_r2_object_id
              FROM account a
              JOIN member m ON a.id = m.account_id
              JOIN organization o ON m.organization_id = o.id
              WHERE a.id = ?
            `
        )
        .bind(user.id) 
        .first();

      const org: any = await db
        .prepare(
          `
              SELECT o.id, o.name, o.logo_r2_object_id
              FROM account a
              JOIN member m ON a.id = m.account_id
              JOIN organization o ON m.organization_id = o.id
              WHERE a.id = ?
            `
        )
        .bind(user.id) 
        .first();

      const org: any = await db
        .prepare(
          `
              SELECT o.id, o.name, o.logo_r2_object_id
              FROM account a
              JOIN member m ON a.id = m.account_id
              JOIN organization o ON m.organization_id = o.id
              WHERE a.id = ?
            `
        )
        .bind(user.id) 
        .first();

L

Larry•4/7/24, 6:22 PM

How does drizzle compare to prisma?

K

kindaraffy•4/7/24, 6:26 PM

Drizzle is known to be more performant than prisma in the way it translates queries over. Drizzle seems to be more adaptive to products (has pretty good support for D1 in particular).

K

kindaraffy•4/7/24, 6:28 PM

Where can I find all the cloudflare locations that D1 has support in. All I can find is this in the docs: https://developers.cloudflare.com/d1/configuration/data-location/#available-hints. And I saw some hints to D1 coming to Australia this week. Is there a place where I can see all currently supported locations?

Cloudflare Docs

Data location · Cloudflare D1 docs

Learn how the location of data stored in D1 is determined, including where the leader is placed and how you optimize that location based on your …

Kkindaraffy Where can I find all the cloudflare locations that D1 has support in. All I can ...

K

kindaraffy•4/7/24, 6:28 PM

^ would appreciate the info for durable objects as well.

Original message was deleted

E

EvanPiro•4/7/24, 6:29 PM

I actually just want to keep the table schemas in SQL and just use a query builder. I just rolled my own, which wasn't that much code and fulfills my needs:

      const query = q.toQuery([
        q.select(["o.id", "o.name", "o.logo_r2_object_id"]),
        q.from("account a"),
        q.join("member m", "a.id = m.account_id"),
        q.join("organization o", "m.organization_id = o.id"),
        q.where("a.id = ?"),
      ]);
      const org: any = await db.prepare(query).bind(user.id).first();

      const query = q.toQuery([
        q.select(["o.id", "o.name", "o.logo_r2_object_id"]),
        q.from("account a"),
        q.join("member m", "a.id = m.account_id"),
        q.join("organization o", "m.organization_id = o.id"),
        q.where("a.id = ?"),
      ]);
      const org: any = await db.prepare(query).bind(user.id).first();

      const query = q.toQuery([
        q.select(["o.id", "o.name", "o.logo_r2_object_id"]),
        q.from("account a"),
        q.join("member m", "a.id = m.account_id"),
        q.join("organization o", "m.organization_id = o.id"),
        q.where("a.id = ?"),
      ]);
      const org: any = await db.prepare(query).bind(user.id).first();

      const query = q.toQuery([
        q.select(["o.id", "o.name", "o.logo_r2_object_id"]),
        q.from("account a"),
        q.join("member m", "a.id = m.account_id"),
        q.join("organization o", "m.organization_id = o.id"),
        q.where("a.id = ?"),
      ]);
      const org: any = await db.prepare(query).bind(user.id).first();

I spent more time researching if a simple one exists lol

Kkindaraffy Where can I find all the cloudflare locations that D1 has support in. All I can ...

H

Hello, I’m Allie!•4/7/24, 6:29 PM

https://where.durableobjects.live is a community project that shows where DOs can run

Where Durable Objects Live

Tracking where Durable Objects are created, wherever you are in the world.

H

Hello, I’m Allie!•4/7/24, 6:30 PM

IIRC since DOs recently rolled out Oceania datacenters, D1 should :soontm: support them too

K

kindaraffy•4/7/24, 6:31 PM

Thanks.

CChaika even besides the rate limit, currently each query via the cf api would have to b...

F

FalhadoNaMissao•4/7/24, 6:59 PM

thanks for the response

C

Cloud Kung Fu•4/7/24, 7:55 PM

Hey, does anybody have an example implementation of next-auth + d1 for next.js?

Aadjlsncm in order to interact with the local d1 database are you limited to having to reb...

B

bun•4/7/24, 9:07 PM

bro how often do you change your db. also i dont think you need to restart dev server when you change your db.

CCloud Kung Fu Hey, does anybody have an example implementation of next-auth + d1 for next.js?

B

bun•4/7/24, 9:07 PM

for the love of god dont use next-auth its very bad

F

Fabian•4/7/24, 10:00 PM

hey guys, anyone has an idea how to bind dates in a query? I basically have a

DATETIME

DATETIME

DATETIME

DATETIME column, and when I run a query using

WHERE xyz BETWEEN ? AND ?

WHERE xyz BETWEEN ? AND ?

WHERE xyz BETWEEN ? AND ?

WHERE xyz BETWEEN ? AND ? and passing in a date it always results in

Type 'object' not supported for value 'Thu Apr 04 2024 23:54:22 GMT+0200 (Central European Summer Time)'

Type 'object' not supported for value 'Thu Apr 04 2024 23:54:22 GMT+0200 (Central European Summer Time)'

Type 'object' not supported for value 'Thu Apr 04 2024 23:54:22 GMT+0200 (Central European Summer Time)'

Type 'object' not supported for value 'Thu Apr 04 2024 23:54:22 GMT+0200 (Central European Summer Time)' which obviously means that the D1 client apparently cannot handle date objects. It works when passing in an ISO string, but it's really annoying when working with ORMs and schema libraries. So is there a known workaround or am I somehow using an outdated version?

B

bun•4/7/24, 10:09 PM

there are no date types in sqlite, so the issue solely depends on what ORM you're using

F

Fabian•4/7/24, 10:10 PM

Well I mean the column is defined as date, so the D1 client could convert the string to a native date. But I guess I'll have to switch ORM then

F

Fabian•4/7/24, 10:10 PM

or vice-versa

Rrenzor this worked for me ``` export const UsersTable = sqliteTable("users", { userna...

B

bun•4/7/24, 10:11 PM

if you are using drizzle:
i personally use unix timestamp for dates like:

createdAt: int("created_at", { mode: "timestamp" })
      .default(sql`(unixepoch())`)
      .notNull(),

createdAt: int("created_at", { mode: "timestamp" })
      .default(sql`(unixepoch())`)
      .notNull(),

createdAt: int("created_at", { mode: "timestamp" })
      .default(sql`(unixepoch())`)
      .notNull(),

createdAt: int("created_at", { mode: "timestamp" })
      .default(sql`(unixepoch())`)
      .notNull(),

but renzor also pointed out he works with

text

text

text

text dates

Original message was deleted

C

Cloud Kung Fu•4/7/24, 10:12 PM

Thnx

B

bun•4/7/24, 10:12 PM

upon looking up docs for sqlite it says it only works with

ISO8601

ISO8601

ISO8601

ISO8601 dates

Bbun for the love of god dont use next-auth its very bad

C

Cloud Kung Fu•4/7/24, 10:12 PM

What makes you say that?

B

bun•4/7/24, 10:12 PM

limiting/confusing/terrible docs

B

bun•4/7/24, 10:12 PM

i would use lucia if i were to use a ready solution for auth

Bbun i would use lucia if i were to use a ready solution for auth

C

Cloud Kung Fu•4/7/24, 10:13 PM

I see what you mean, appreciate the recc, will definitely check that out

Original message was deleted

C

Cloud Kung Fu•4/7/24, 10:17 PM

I wish I saw this earlier!

Bbun upon looking up docs for sqlite it says it only works with `ISO8601` dates

F

Fabian•4/7/24, 10:19 PM

Yeah I see. But I still think that the D1 client could, instead of throwing an exception when passing in a Date object, automatically convert it to a ISO date. I don't see a problem doing that.
And, while we are at it, automatically convert ISO timestamps to a native date object. This would be a breaking change tho.
They do the same for other data-types, like boolean to int conversion and vice-versa. This is just a developer quality-of-life feature in my opinion, and not a limitation of SQLite.

C

Chihwei•4/7/24, 10:21 PM

Is there any handy ORM for workers-rs with D1?

R

Rubi•4/7/24, 10:40 PM

hi, I'm using SvelteKit

I got this error while trying to execute a query:

Error: D1_ERROR: no such table: countries

Error: D1_ERROR: no such table: countries

Error: D1_ERROR: no such table: countries

Error: D1_ERROR: no such table: countries

I wonder what's wrong

J

James•4/7/24, 10:43 PM

If you're developing locally, keep in mind that the data remotely (what you see in the cf dash) likely isn't what you have locally.

in order to interact with the local d1 database are you limited to having to rebuild with cloudflare

Similar Threads

Similar Threads

Similar Threads