MMax (@rozenmd)we're probably limited by the api gateway

I

itsmatteomanf•10/12/23, 11:08 AM

But is there really a 100% overhead considering I’ve seen many other endpoints being limited at 100MB? I had 50MB of data…

I

itsmatteomanf•10/12/23, 11:09 AM

(The full statement, not the CSV I started from)

R

roftt•10/12/23, 11:12 AM

If I'm not logged in in wrangler, can I run something like this?: CLOUDFLARE_ACCOUNT_ID=1234 CLOUDFLARE_API_TOKEN=4321 wrangler d1 execute test-database --command="SELECT * FROM Customers"

Somehow I did yesterday but it's not working now. Or am I completely missing something?

Rroftt If I'm not logged in in wrangler, can I run something like this?: CLOUDFLARE_ACC...

M

Max (@rozenmd)OP•10/12/23, 11:15 AM

you should be, what does "not working" mean, error message?

M

Max (@rozenmd)OP•10/12/23, 11:15 AM

you can debug that your tokens are right via

CLOUDFLARE_ACCOUNT_ID=1234 CLOUDFLARE_API_TOKEN=4321 wrangler whoami

CLOUDFLARE_ACCOUNT_ID=1234 CLOUDFLARE_API_TOKEN=4321 wrangler whoami

Iitsmatteomanf But is there really a 100% overhead considering I’ve seen many other endpoints b...

M

Max (@rozenmd)OP•10/12/23, 11:16 AM

i dont understand the question tbh

MMax (@rozenmd)i dont understand the question tbh

I

itsmatteomanf•10/12/23, 11:19 AM

Like, I had a ~50MB .sql file, which I executed and failed. If the limit is 100MB on the gateway (assuming it as the one used by other endpoints, like KV…) it assumes there is a ton of overhead on the actually query, which seems strange

M

Max (@rozenmd)OP•10/12/23, 11:28 AM

like if you have a 49mb file, does it work?

M

Max (@rozenmd)OP•10/12/23, 11:30 AM

i'm just saying i doubt we changed the default api gateway limits for d1 since the alpha would crash if you looked at it wrong

MMax (@rozenmd)you should be, what does "not working" mean, error message?

R

roftt•10/12/23, 12:05 PM

'CLOUDFLARE_ACCOUNT_ID' is not recognized as an internal or external command, operable program or batch file.

Rroftt 'CLOUDFLARE_ACCOUNT_ID' is not recognized as an internal or external command, op...

M

Max (@rozenmd)OP•10/12/23, 12:06 PM

that'll be it then -

CLOUDFLARE_ACCOUNT_ID=1234 CLOUDFLARE_API_TOKEN=4321 wrangler d1 execute test-database --command="SELECT * FROM Customers"

CLOUDFLARE_ACCOUNT_ID=1234 CLOUDFLARE_API_TOKEN=4321 wrangler d1 execute test-database --command="SELECT * FROM Customers"

needs to be run from a linux-like environment

M

Max (@rozenmd)OP•10/12/23, 12:06 PM

otherwise you need to add

CLOUDFLARE_ACCOUNT_ID

CLOUDFLARE_ACCOUNT_ID

and

CLOUDFLARE_API_TOKEN

CLOUDFLARE_API_TOKEN

to your windows system env vars

MMax (@rozenmd)that'll be it then - `CLOUDFLARE_ACCOUNT_ID=1234 CLOUDFLARE_API_TOKEN=4321 wrang...

R

roftt•10/12/23, 12:08 PM

Oh, thanks! Forgot that I ran it from my ec2 linux instance

Mming Hi, I would like to build a worker application; and I want the browser to receiv...

M

Max (@rozenmd)OP•10/12/23, 2:36 PM

Not yet - best you can do is use a cron trigger (https://developers.cloudflare.com/workers/configuration/cron-triggers) and check manually every 60 seconds

Mming thanks. Is there a plan to support this? Something like change data capture for ...

M

Max (@rozenmd)OP•10/12/23, 2:39 PM

it's in the backlog, yep

J

Jsx•10/12/23, 3:40 PM

Just a curios question.
Will D1 make out of workers environment and become like a standalone DB as a service?

Original message was deleted

M

Max (@rozenmd)OP•10/12/23, 7:07 PM

i've actually been slowly iterating on that UI so i can write my articles in there

LLane C Is D1 super slow with multiple joins? I have a simple blog schema. I have less t...

M

Max (@rozenmd)OP•10/12/23, 7:17 PM

actually noticing this might be an issue with LIMIT/OFFSET, will raise it internally

A

AliAlhusainy•10/12/23, 7:41 PM

Hi

S

Samantas5855•10/12/23, 8:38 PM

Is it possible to perform many insertions without repeating the query on the https api? Something similar to this syntax:

K

kian•10/13/23, 1:03 AM

There's nothing special about how D1 handles it, so you can do whatever SQLite supports. For example, you can repeat the values to insert several rows.

INSERT INTO test (id) VALUES (1), (2), (3), (4), (5)

INSERT INTO test (id) VALUES (1), (2), (3), (4), (5)

INSERT INTO test (id) VALUES (1), (2), (3), (4), (5)

INSERT INTO test (id) VALUES (1), (2), (3), (4), (5)

K

kian•10/13/23, 1:05 AM

If you wanted to use parameters, then you'd do this.

{
  "params": [
    1,
    2,
    3,
    4,
    5
  ],
  "sql": "INSERT INTO test (id) VALUES (?), (?), (?), (?), (?)"
}

{
  "params": [
    1,
    2,
    3,
    4,
    5
  ],
  "sql": "INSERT INTO test (id) VALUES (?), (?), (?), (?), (?)"
}

{
  "params": [
    1,
    2,
    3,
    4,
    5
  ],
  "sql": "INSERT INTO test (id) VALUES (?), (?), (?), (?), (?)"
}

{
  "params": [
    1,
    2,
    3,
    4,
    5
  ],
  "sql": "INSERT INTO test (id) VALUES (?), (?), (?), (?), (?)"
}

K

kian•10/13/23, 1:05 AM

You can take a look at https://www.sqlite.org/lang_insert.html for the syntax of

INSERT

INSERT

.

S

Santa DCON 🎄•10/13/23, 2:47 AM

Yay a bug! Not sure if posted, but if the primary key is set to null, the dashboard's update function fails to open:

S

Santa DCON 🎄•10/13/23, 2:47 AM

R

roftt•10/13/23, 5:51 AM

How do I check geolocation of my D1 database?

Rroftt How do I check geolocation of my D1 database?

M

Max (@rozenmd)OP•10/13/23, 6:56 AM

wrangler d1 info <DBNAME>

wrangler d1 info <DBNAME>

M

MrXO•10/13/23, 10:03 AM

is it expensive to use d1 for an ecommerce platform?

Mming I was wondering if I could do this: 1. Client/browser connect to my worker usin...

M

Max (@rozenmd)OP•10/13/23, 10:16 AM

you could probably do something like that now with a websocket in durable objects

M

Max (@rozenmd)OP•10/13/23, 10:16 AM

just manually setAlarm every N seconds

G

GuillaumeLakano•10/13/23, 12:30 PM

How can we create a local D1 database please? The --local flag doesn't seems to works, I've tried to add a binding in wrangler.toml but I'm forced to fill an UUID ( not yet created, and even if I force it to something random it's not works )

FFerry That works, but be aware there is a limit to the number of bound variables , whi...

K

kian•10/13/23, 12:43 PM

Just send more than one query then? 100 in one query seems more than acceptable.

K

kian•10/13/23, 12:44 PM

SQLite’s recommended high security value is 10, so D1 is already 10x’d that.

GGuillaumeLakano How can we create a local D1 database please? The --local flag doesn't seems to ...

W

w3bcode•10/13/23, 12:46 PM

I had the same issue, Local development with D1 is not working for me. So as a workaround I am using preview DB on remote

Ww3bcode I had the same issue, Local development with D1 is not working for me. So as a w...

G

GuillaumeLakano•10/13/23, 12:48 PM

Thank you for your feedback, few weeks ago I could create one in local, I don't remember how, may be with the --local ( or without the --remote flag, this is not really clear when we need one or not )

G

GuillaumeLakano•10/13/23, 12:49 PM

Currently, if I don't uses the --local flag, it's create the DB in remote ( and without any --remote flag )

E

Elliot Hesp•10/13/23, 2:14 PM

I've got a wranger.toml file like so

[env.production]
name = "krypton"
logpush = true
workers_dev = true
d1_databases = [
  { binding = "DB", database_name = "krypton", database_id = "<123>" },
]

[env.production]
name = "krypton"
logpush = true
workers_dev = true
d1_databases = [
  { binding = "DB", database_name = "krypton", database_id = "<123>" },
]

[env.production]
name = "krypton"
logpush = true
workers_dev = true
d1_databases = [
  { binding = "DB", database_name = "krypton", database_id = "<123>" },
]

[env.production]
name = "krypton"
logpush = true
workers_dev = true
d1_databases = [
  { binding = "DB", database_name = "krypton", database_id = "<123>" },
]

When I deploy, it deploys with the D1 database as expected bound. However when I run:

wrangler d1 migrations apply krypton

wrangler d1 migrations apply krypton

I get the error,

Can't find a DB with name/binding 'krypton' in local config. Check info in wrangler.toml...

Can't find a DB with name/binding 'krypton' in local config. Check info in wrangler.toml...

Migrations work for the non-prod env. No idea :/

K

kian•10/13/23, 2:16 PM

Try

wrangler d1 migrations apply krypton --env production

wrangler d1 migrations apply krypton --env production

E

Elliot Hesp•10/13/23, 2:17 PM

Thank you!

GGuillaumeLakano Thank you for your feedback, few weeks ago I could create one in local, I don't ...

M

Matt Silverlock•10/13/23, 2:26 PM

Can you please open a GitHub issue with a reproduction and/or where the docs fail you? https://developers.cloudflare.com/d1/learning/local-development/

Local development · Cloudflare D1 docs

D1 has fully-featured support for local development, running the same version of D1 as Cloudflare runs globally. Local development uses Wrangler, the …

T

Talaat•10/13/23, 2:45 PM

Hello
Can anyone guide me on how to connect workers with Cloudflare d1 and different environments
The connection is fine if i go with the default wrangler.toml configuration but the moment i go with this approach (Check code below) the db connection never happens at all

Approach i am trying to use

This is a staging environment

[env.staging]
d1_databases = [
{ binding = "DB", database_name = "<DATABASE_NAME_1>", database_id = "<UUID1>" },
]

This is a production environment

[env.production]
d1_databases = [
{ binding = "DB", database_name = "<DATABASE_NAME_2>", database_id = "<UUID2>" },
]

MY BINDING

export type Bindings = {
    DB: D1Database;
    ACCESS_TOKEN_SECRET: string;
};

export type Bindings = {
    DB: D1Database;
    ACCESS_TOKEN_SECRET: string;
};

my endpoint (Using hono js)

app.get('/', async (c) => {
    const res1 = await c.env.DB.prepare('SELECT * from testTable;').all();
    return c.json({ status: 'success', message: res1 });
});

app.get('/', async (c) => {
    const res1 = await c.env.DB.prepare('SELECT * from testTable;').all();
    return c.json({ status: 'success', message: res1 });
});

app.get('/', async (c) => {
    const res1 = await c.env.DB.prepare('SELECT * from testTable;').all();
    return c.json({ status: 'success', message: res1 });
});

app.get('/', async (c) => {
    const res1 = await c.env.DB.prepare('SELECT * from testTable;').all();
    return c.json({ status: 'success', message: res1 });
});

T

Talaat•10/13/23, 2:45 PM

i then get the following error
Trace: TypeError: Cannot read properties of undefined (reading 'prepare')
at file:///C:/Users/User/AppData/Local/Temp/tmp-3404-1q9ZFqgbsFEX/index.js:8029:31
at dispatch (file:///C:/Users/User/AppData/Local/Temp/tmp-3404-1q9ZFqgbsFEX/index.js:561:17)
at file:///C:/Users/User/AppData/Local/Temp/tmp-3404-1q9ZFqgbsFEX/index.js:562:33
at file:///C:/Users/User/AppData/Local/Temp/tmp-3404-1q9ZFqgbsFEX/index.js:1628:11
at dispatch (file:///C:/Users/User/AppData/Local/Temp/tmp-3404-1q9ZFqgbsFEX/index.js:561:17)
at file:///C:/Users/User/AppData/Local/Temp/tmp-3404-1q9ZFqgbsFEX/index.js:544:12
at file:///C:/Users/User/AppData/Local/Temp/tmp-3404-1q9ZFqgbsFEX/index.js:1009:21
at Hono2.dispatch (file:///C:/Users/User/AppData/Local/Temp/tmp-3404-1q9ZFqgbsFEX/index.js:1020:7)
at Hono.fetch (file:///C:/Users/User/AppData/Local/Temp/tmp-3404-1q9ZFqgbsFEX/index.js:811:19) {
stack: TypeError: Cannot read properties of undefined (re…Local/Temp/tmp-3404-1q9ZFqgbsFEX/index.js:811:19),
message: Cannot read properties of undefined (reading 'prepare')

Would really appreciate your help

TTalaat Hello Can anyone guide me on how to connect workers with Cloudflare d1 and diffe...

C

Cyb3r-Jak3•10/13/23, 3:05 PM

Does

wrangler dev —env staging

wrangler dev —env staging

work?

we're probably limited by the api gateway

This is a staging environment

This is a production environment

Similar Threads

This is a staging environment

This is a production environment