I have a billing question. If I have a table full of indexed images and I want to read one I know th

I have a billing question. If I have a table full of indexed images and I want to read one I know the index of how many read units would that use? Would it have to scan the whole table? Or would knowing the index just make it one read unit with the right query?

SStronk I have a billing question. If I have a table full of indexed images and I want t...

Matt Silverlock•5/29/23, 11:00 PM

One for the index and one for the table row, as a generalization / not committal.

yeehow•5/29/23, 11:16 PM

Have a 100k line SQL import I want to do.
Gets hung up on "Mapping SQL input into an array of statements"

Read that splitting into files with 5k lines helps.
Any tools to do this or should I just manually go through it?

MMatt Silverlock One for the index and one for the table row, as a generalization / not committal...

StronkOP•5/30/23, 12:53 AM

From my understanding that doesn't make sense. Aren't the read units based on how many 4 kB chunks you use when searching. So if the image is under 4 kilobytes including the index it should be one read if it doesn't have to scan the rest of the table right.

SStronk From my understanding that doesn't make sense. Aren't the read units based on ho...

Matt Silverlock•5/30/23, 1:12 AM

Reading an index will likely always be an additional operation (read unit). We will make this clearer in the docs as we refine our pricing.

StronkOP•5/30/23, 1:12 AM

Cool

StronkOP•5/30/23, 1:13 AM

Is there a way I can test how a lookup would be counted during this time?

SStronk Is there a way I can test how a lookup would be counted during this time?

Matt Silverlock•5/30/23, 1:15 AM

Not yet, per the docs: https://developers.cloudflare.com/d1/platform/pricing/

we are working on it. Won’t be within the next month. Focusing on Time Travel and stability.

Pricing · Cloudflare D1 docs

While in public Alpha, D1 is currently free to use on all Workers plans. Refer to the our recent announcement) for more information.

SStronk Is there a way I can test how a lookup would be counted during this time?

Matt Silverlock•5/30/23, 1:17 AM

Keep in mind that you would need to serve 25 billion requests with that query pattern to exhaust the 50B included read units. 25B / 30 / 86400 = 9600+ requests/sec, 24/7/30.

Yyeehow Have a 100k line SQL import I want to do. Gets hung up on "Mapping SQL input int...

Mozzy•5/30/23, 8:19 AM

I did it manually, but if you do find a good secure tool to use, hit me up

Max (@rozenmd)•5/30/23, 8:44 AM

We're planning on removing the "Mapping SQL input into an array of statements" step from wrangler fwiw

Cconnor hopefully it gets merged soonish :)

Max (@rozenmd)•5/30/23, 9:42 AM

Merged the PR + cleaned up migrations output a bit

Ssteida I bet the Cloudflare team is working on transactions support for the new D1 back...

Max (@rozenmd)•5/30/23, 10:04 AM

D1's experimental backend runs your SQL within a transaction automatically fwiw

Ssteida @rozenmd But my code needs to do something in JavaScript during a transaction. O...

Max (@rozenmd)•5/30/23, 10:10 AM

oh nah I mean when you run

npx wrangler d1 execute

npx wrangler d1 execute

npx wrangler d1 migrations apply

npx wrangler d1 migrations apply

the SQL executes within a transaction

ould you tell me more about what you're trying to do?

Ssteida @rozenmd https://blog.cloudflare.com/d1-turning-it-up-to-11/ transactions are no...

Matt Silverlock•5/30/23, 5:16 PM

We’re looking at alternatives that make it easier to interleave SQL and JS. We can’t give you a specific timeline. The blog highlights what we are focusing on in the near term for D1.

Max (@rozenmd)•5/30/23, 6:43 PM

i think we borrowed that from the cf v4 api

Murder Chicken•5/30/23, 7:53 PM

Anyone else getting this when trying to use the experimental backend for new D1 databases?

not authorized to use function: strftime

not authorized to use function: strftime

Murder Chicken•5/30/23, 7:54 PM

Works locally and worked with old DBs. Tried to create a copy of my DB with the experimental backend and I'm now getting this error.

MMurder Chicken Anyone else getting this when trying to use the experimental backend for new D1 ...

Max (@rozenmd)•5/30/23, 8:01 PM

can you file an issue against workerd? https://github.com/cloudflare/workerd/issues
we're gradually allow-listing functions and may have missed a few

MMax (@rozenmd)can you file an issue against workerd? https://github.com/cloudflare/workerd/iss...

Murder Chicken•5/30/23, 8:02 PM

Will do that right now!

MMax (@rozenmd)can you file an issue against workerd? https://github.com/cloudflare/workerd/iss...

Murder Chicken•5/30/23, 8:07 PM

Any expectation on how long that'll take to make it in? Curious if I should roll back to my old DB and write batching functions instead (which is why I was trying a move to the new backend).

itsmatteomanf•5/30/23, 8:12 PM

Any specific reasoning why

CURRENT_TIMESTAMP

CURRENT_TIMESTAMP

works when using it as the default for a column in the schema, but fails when used in any kind of statement (with a "not authorized")?

itsmatteomanf•5/30/23, 8:14 PM

To note, a

datetime('now')

datetime('now')

works fine in the statement.

MMurder Chicken Any expectation on how long that'll take to make it in? Curious if I should rol...

Max (@rozenmd)•5/30/23, 8:17 PM

it depends if it's a standard thing we missed - CC: @elithrar

MMurder Chicken Any expectation on how long that'll take to make it in? Curious if I should rol...

Matt Silverlock•5/30/23, 9:11 PM

No faster than a week.

kian•5/30/23, 9:36 PM

A random guess is that the D1 shim seems to do some ArrayBuffer conversions of it's own (https://github.com/cloudflare/workers-sdk/blob/main/packages/wrangler/templates/d1-beta-facade.js#L112-L149)

itsmatteomanf•5/31/23, 7:36 AM

Are foreign keys actually supported? It accepts them in the schema, but it doesn't enforce them, at all.

itsmatteomanf•5/31/23, 10:06 AM

Yeah, I know SQLite supports that, but they specifically state that the

PRAGMA foreign_keys = on;

PRAGMA foreign_keys = on;

command is supported in the docs.

itsmatteomanf•5/31/23, 10:07 AM

https://developers.cloudflare.com/d1/platform/client-api/#pragma-statements

Iitsmatteomanf Any specific reasoning why `CURRENT_TIMESTAMP` works when using it as the defaul...

itsmatteomanf•5/31/23, 10:09 AM

I saw your

, @rozenmd, can I expect it to work at some point or not? Just to design the schema and Workers accordingly.

Iitsmatteomanf I saw your 🤔, @rozenmd, can I expect it to work at some point or not? Just to d...

Max (@rozenmd)•5/31/23, 10:12 AM

let me ask internally, I'm not sure

Iitsmatteomanf Any specific reasoning why `CURRENT_TIMESTAMP` works when using it as the defaul...

Max (@rozenmd)•5/31/23, 12:20 PM

can you file a github issue for this in workerd? https://github.com/cloudflare/workerd/issues

Ttobias I was trying to run a migration with following content. ```sql CREATE VIRTUAL TA...

Max (@rozenmd)•5/31/23, 12:23 PM

can you rerun it with fts5fts5 instead of FTS5FTS5? looks like a bug

MMax (@rozenmd)can you file a github issue for this in workerd? https://github.com/cloudflare/w...

itsmatteomanf•5/31/23, 12:31 PM

https://github.com/cloudflare/workerd/issues/718

GitHub

🐛 Bug Report — Runtime APIs: D1 Does Not Allow `CURRENT_TIMESTAMP` ...

The Experimental Backend doesn't allow using CURRENT_TIMESTAMP when running any type of query. It's supported perfectly when it's set as default value for a column.

Lleonhma does anyone know whether D1 supports the unixepoch expression? (`createdAt integ...

Matt Silverlock•5/31/23, 1:07 PM

unixepochunixepoch is supported. Does that create table statement work outside of D1? Usually you can’t have functions like that.

I have a billing question. If I have a table full of indexed images and I want to read one I know th

Similar Threads

Similar Threads

Similar Threads