You should not expect D1 to be outright faster than a hot (cached) KV read. How are you measuring qu

MMatt Silverlock You should not expect D1 to be outright faster than a hot (cached) KV read. How ...

V

Vikash•10/6/23, 11:46 AM

Yes, I am not considering that. Here is response on a worker where duration is : 0.689.
I guess that's more half second.

"success":true,"meta":{"served_by":"v3-prod","duration":0.689,"changes":0,"last_row_id":0,"changed_db":false,"size_after":81920,"rows_read":43,"rows_written":0},"results": [....]

"success":true,"meta":{"served_by":"v3-prod","duration":0.689,"changes":0,"last_row_id":0,"changed_db":false,"size_after":81920,"rows_read":43,"rows_written":0},"results": [....]

"success":true,"meta":{"served_by":"v3-prod","duration":0.689,"changes":0,"last_row_id":0,"changed_db":false,"size_after":81920,"rows_read":43,"rows_written":0},"results": [....]

"success":true,"meta":{"served_by":"v3-prod","duration":0.689,"changes":0,"last_row_id":0,"changed_db":false,"size_after":81920,"rows_read":43,"rows_written":0},"results": [....]

https://development.pricetree-angular.pages.dev/api/products

V

Vikash•10/6/23, 11:48 AM

And some time even more than 1 second -

K

Kuririn•10/6/23, 12:01 PM

I have query like this:

const response = await env.DB.prepare(`
                UPDATE Promotions 
                SET content = ?, last_update_time = ?
                WHERE promo_id = ?
            `).bind(JSON.stringify(page), currentTimeInSeconds, page.id).run();

const response = await env.DB.prepare(`
                UPDATE Promotions 
                SET content = ?, last_update_time = ?
                WHERE promo_id = ?
            `).bind(JSON.stringify(page), currentTimeInSeconds, page.id).run();

const response = await env.DB.prepare(`
                UPDATE Promotions 
                SET content = ?, last_update_time = ?
                WHERE promo_id = ?
            `).bind(JSON.stringify(page), currentTimeInSeconds, page.id).run();

const response = await env.DB.prepare(`
                UPDATE Promotions 
                SET content = ?, last_update_time = ?
                WHERE promo_id = ?
            `).bind(JSON.stringify(page), currentTimeInSeconds, page.id).run();

but it doesn't update the record and doesn’t return anything or throw an error.

My only idea is that page is too big, but something similar works for insert.
But it would be weird that I can't update big values (article).

VVikash And some time even more than 1 second -

M

Matt SilverlockOP•10/6/23, 12:19 PM

Duration is in milliseconds

KKuririn I have query like this: ```const response = await env.DB.prepare(` ...

M

Matt SilverlockOP•10/6/23, 12:19 PM

Try it without calling stringify, and just pass in a plain value first

MMatt Silverlock Try it without calling stringify, and just pass in a plain value first

V

Vikash•10/6/23, 12:21 PM

I am using Hono

.json()

.json()

.json()

.json(), I will test without that -

products.get('/', async (c) => {
const { offset = 0, limit = 1000 } = c.req.query();
const results = await getProducts(c, Number(offset), Number(limit));
return c.json(results as Product[]);
});

VVikash I am using Hono `.json()`, I will test without that - products.get('/', async...

M

Matt SilverlockOP•10/6/23, 12:25 PM

I replied to the other user

MMatt Silverlock I replied to the other user 🙂

V

Vikash•10/6/23, 12:26 PM

MMatt Silverlock Try it without calling stringify, and just pass in a plain value first

K

Kuririn•10/6/23, 12:55 PM

It doesn’t work without stringify, but I noticed it worked once finally (after many trials). It was probably cloudflare issue (didn't execute code and didn't return the promise). I will test it again.

KKuririn It doesn’t work without stringify, but I noticed it worked once finally (after m...

M

Matt SilverlockOP•10/6/23, 12:57 PM

And you changed nothing at all?

K

Kuririn•10/6/23, 1:01 PM

let me check again, I'm trying so many different things that I'm confused

K

Kuririn•10/6/23, 1:06 PM

Sorry man! It worked without stringify. I got some D1 error about object when testing before but it worked nevertheless. And now it works without the object error.

K

Kuririn•10/6/23, 1:06 PM

I'm using insert with strinigify and it works, when I should use it and when not?

Ttouhidurrr 🇵🇸Is there any way to use D1 directly from my app without using workers?

K

Kuririn•10/6/23, 1:09 PM

I don't think so. I use worker to provide an api for my app.

KKuririn Sorry man! It worked without stringify. I got some D1 error about object when te...

K

Kuririn•10/6/23, 1:12 PM

I got the error again:
for value "D1_TYPE_ERROR: Type 'object' not supported [Object object]''

K

Kuririn•10/6/23, 1:13 PM

I'm totally confused now, because it worked once, then without changing the code it throw this error

K

Kuririn•10/6/23, 1:15 PM

orr diffrent versions are running, I will check without stringify once again

KKuririn I'm using insert with strinigify and it works, when I should use it and when not...

M

Matt SilverlockOP•10/6/23, 1:18 PM

Your JSON.stringify call is likely returning an object that isn’t what your query can bind. You should prep the bound variable before you pass it to your query.

KKuririn I got the error again: for value "D1_TYPE_ERROR: Type 'object' not supported [Ob...

M

Matt SilverlockOP•10/6/23, 1:18 PM

If you stringify and then log that result I guarantee it is not what you are expecting

K

Kuririn•10/6/23, 1:37 PM

I finally figured it out, this call was in async foreach loop and script ended too soon without waiting for the response , I changed it to for of loop and it seems to work now

E

EvanPiro•10/6/23, 3:28 PM

Is it possible to easily pull a remote database copy into local using wrangler?

MMax (@rozenmd)? ` success: boolean, // true if the operation was successful, false otherwise`

C

Cretezy•10/6/23, 3:44 PM

C

Cretezy•10/6/23, 3:44 PM

success

success

success

success can only be

true

true

in the TypeScript typings

C

Cretezy•10/6/23, 3:44 PM

node_modules/@cloudflare/workers-types/index.d.ts

node_modules/@cloudflare/workers-types/index.d.ts

node_modules/@cloudflare/workers-types/index.d.ts

node_modules/@cloudflare/workers-types/index.d.ts

CCretezy `success` can only be `true` in the TypeScript typings

M

Max (@rozenmd)•10/6/23, 3:51 PM

success

success

success

success can only be

true

true

in the D1Result type, see D1UpstreamFailure:

interface D1UpstreamFailure {
  results?: never
  error: string
  success: false
  meta: Record<string, unknown>
}

interface D1UpstreamFailure {
  results?: never
  error: string
  success: false
  meta: Record<string, unknown>
}

interface D1UpstreamFailure {
  results?: never
  error: string
  success: false
  meta: Record<string, unknown>
}

interface D1UpstreamFailure {
  results?: never
  error: string
  success: false
  meta: Record<string, unknown>
}

C

Cretezy•10/6/23, 3:52 PM

I don't see

D1UpstreamFailure

D1UpstreamFailure

D1UpstreamFailure

D1UpstreamFailure is this file. I'm using

"@cloudflare/workers-types": "^4.20230814.0"

"@cloudflare/workers-types": "^4.20230814.0"

"@cloudflare/workers-types": "^4.20230814.0"

"@cloudflare/workers-types": "^4.20230814.0", will update

C

Cretezy•10/6/23, 3:53 PM

Still nothing in

4.20231002.0

4.20231002.0

4.20231002.0

4.20231002.0. @rozenmd Can you link me to this file?

K

kian•10/6/23, 3:54 PM

D1UpstreamFailure

D1UpstreamFailure

D1UpstreamFailure

D1UpstreamFailure is in the binding rather than the types so the users don't see it

M

Max (@rozenmd)•10/6/23, 3:54 PM

ahhh

M

Max (@rozenmd)•10/6/23, 3:54 PM

Yeah we should probably export it

C

Cretezy•10/6/23, 3:54 PM

Either way, I think it would be good to mark in the documentation what happens if

success

success

success

success is

false

false

for methods which don't return it

C

Cretezy•10/6/23, 3:54 PM

E.g., what happens if

success

success

success

success is

false

false

for

first

first

first

first. Does it throw an error, return null, etc

C

Cretezy•10/6/23, 3:55 PM

Also, should we be checking if

success

success

success

success is

true

true

on every call that returns it? I've been assuming if there's an upstream error it will throw

C

Cretezy•10/6/23, 3:59 PM

Another note: https://developers.cloudflare.com/workers/wrangler/commands/#execute should likely mention

--local

--local

Commands - Wrangler · Cloudflare Workers docs

Wrangler offers a number of commands to manage your Cloudflare Workers.

M

Matt SilverlockOP•10/6/23, 4:13 PM

Just landed: every D1 account (on a paid plan) can create up to 50,000 databases, no changes needed: https://developers.cloudflare.com/d1/changelog/#create-up-to-50000-d1-databases

Changelog · Cloudflare D1 docs

Developers using D1 on a Workers Paid plan can now create up to 50,000 databases as part of ongoing increases to D1’s limits.

MMatt Silverlock Just landed: every D1 account (on a paid plan) can create up to 50,000 databases...

C

Cyb3r-Jak3•10/6/23, 4:15 PM

FYI it looks like the reach out link isn’t rendered correctly

MMatt Silverlock Just landed: every D1 account (on a paid plan) can create up to 50,000 databases...

G

GuillaumeLakano•10/6/23, 4:15 PM

There is still the limitation of ~5k per worker to access the D1 databases ?

S

Sam•10/6/23, 4:18 PM

Are jurisdictions still on the roadmap for D1 GA? I found https://discord.com/channels/595317990191398933/1067184198206640188/1124269952237568041 but want to make doubly sure

SSam Are jurisdictions still on the roadmap for D1 GA? I found https://discord.com/ch...

M

Matt SilverlockOP•10/6/23, 4:19 PM

Yes.

GGuillaumeLakano There is still the limitation of ~5k per worker to access the D1 databases ?

M

Matt SilverlockOP•10/6/23, 4:19 PM

Yes, per the limits here: https://developers.cloudflare.com/d1/platform/limits/

we'll share an update if anything changes.

MMatt Silverlock Yes, per the limits here: https://developers.cloudflare.com/d1/platform/limits/ ...

G

GuillaumeLakano•10/6/23, 4:21 PM

Do you believe you'll be able to have a kind of dynamic bindings to reach any of theses d1 databases before, or at the release in Q1 2024 ?

GGuillaumeLakano Do you believe you'll be able to have a kind of dynamic bindings to reach any of...

M

Matt SilverlockOP•10/6/23, 4:22 PM

That is our goal. As I said, we'll share more when we can.

MMatt Silverlock Just landed: every D1 account (on a paid plan) can create up to 50,000 databases...

E

EvanPiro•10/6/23, 4:24 PM

Does CF have any docs out there to help me determine if the database-per-user model is appropriate for my use-case?

EEvanPiro Does CF have any docs out there to help me determine if the database-per-user mo...

M

Matt SilverlockOP•10/6/23, 4:25 PM

Not at this moment. If you're not sure, I would say: no.

B

bkyerv•10/6/23, 4:32 PM

hello everyone, has anyone had experience setting up drizzle orm with d1? what driver should be used when setting up drizzle config file and what should be used for dbCredentials field?

B

benthecarman•10/6/23, 4:40 PM

Saw you guys made d1 open beta, did you fix the issue where it'll go down for 20+ hours?

E

EvanPiro•10/6/23, 4:53 PM

I'm getting the following error:

$ npx wrangler d1 backup create prod-db

$ npx wrangler d1 backup create prod-db

✘ [ERROR] A request to the Cloudflare API (/accounts/some-id/d1/database/some-id/backup) failed.

  The request is malformed: Experimental DBs do not support backups yet:
  some-id (v3) [code: 7400]
  
  If you think this is a bug, please open an issue at:
  https://github.com/cloudflare/workers-sdk/issues/new/choose

✘ [ERROR] A request to the Cloudflare API (/accounts/some-id/d1/database/some-id/backup) failed.

  The request is malformed: Experimental DBs do not support backups yet:
  some-id (v3) [code: 7400]
  
  If you think this is a bug, please open an issue at:
  https://github.com/cloudflare/workers-sdk/issues/new/choose

✘ [ERROR] A request to the Cloudflare API (/accounts/some-id/d1/database/some-id/backup) failed.

  The request is malformed: Experimental DBs do not support backups yet:
  some-id (v3) [code: 7400]
  
  If you think this is a bug, please open an issue at:
  https://github.com/cloudflare/workers-sdk/issues/new/choose

✘ [ERROR] A request to the Cloudflare API (/accounts/some-id/d1/database/some-id/backup) failed.

  The request is malformed: Experimental DBs do not support backups yet:
  some-id (v3) [code: 7400]
  
  If you think this is a bug, please open an issue at:
  https://github.com/cloudflare/workers-sdk/issues/new/choose

I'm using

wrangler 3.11.0

wrangler 3.11.0

. Is this error expected? Are backups not yet supported?

J

James•10/6/23, 5:00 PM

This is expected, yes. Time Travel is the new approach here: https://developers.cloudflare.com/d1/learning/time-travel/

Time Travel and backups · Cloudflare D1 docs

Time Travel is D1’s approach to backups and point-in-time-recovery, and allows you to restore a database to any minute within the last 30 days.

You should not expect D1 to be outright faster than a hot (cached) KV read. How are you measuring qu

Similar Threads

Similar Threads

Similar Threads