Which specific limits? Per database (2GB) will increase for everyone during the beta, but can’t be i

MMatt Silverlock Yes: https://github.com/elithrar/http-api-d1-example/blob/d5c1eaaac12ef1d3e1d68c...

S

Samantas5855•10/14/23, 12:34 PM

oh thanks, is this endpoint documented?

S

Samantas5855•10/14/23, 12:36 PM

also would it be possible to do

INSERT INTO table (channel, title, start_time, end_time, description) VALUES (?, ?, ?, ?, ?), (?, ?, ?, ?, ?), (?, ?, ?, ?, ?);

INSERT INTO table (channel, title, start_time, end_time, description) VALUES (?, ?, ?, ?, ?), (?, ?, ?, ?, ?), (?, ?, ?, ?, ?);

INSERT INTO table (channel, title, start_time, end_time, description) VALUES (?, ?, ?, ?, ?), (?, ?, ?, ?, ?), (?, ?, ?, ?, ?);

INSERT INTO table (channel, title, start_time, end_time, description) VALUES (?, ?, ?, ?, ?), (?, ?, ?, ?, ?), (?, ?, ?, ?, ?);

instead of doing

INSERT INTO table (channel, title, start_time, end_time, description) VALUES (?, ?, ?, ?, ?);
INSERT INTO table (channel, title, start_time, end_time, description) VALUES (?, ?, ?, ?, ?);
INSERT INTO table (channel, title, start_time, end_time, description) VALUES (?, ?, ?, ?, ?);

INSERT INTO table (channel, title, start_time, end_time, description) VALUES (?, ?, ?, ?, ?);
INSERT INTO table (channel, title, start_time, end_time, description) VALUES (?, ?, ?, ?, ?);
INSERT INTO table (channel, title, start_time, end_time, description) VALUES (?, ?, ?, ?, ?);

INSERT INTO table (channel, title, start_time, end_time, description) VALUES (?, ?, ?, ?, ?);
INSERT INTO table (channel, title, start_time, end_time, description) VALUES (?, ?, ?, ?, ?);
INSERT INTO table (channel, title, start_time, end_time, description) VALUES (?, ?, ?, ?, ?);

INSERT INTO table (channel, title, start_time, end_time, description) VALUES (?, ?, ?, ?, ?);
INSERT INTO table (channel, title, start_time, end_time, description) VALUES (?, ?, ?, ?, ?);
INSERT INTO table (channel, title, start_time, end_time, description) VALUES (?, ?, ?, ?, ?);

SSamantas5855 oh thanks, is this endpoint documented?

M

Matt SilverlockOP•10/14/23, 12:38 PM

It’s in the README: https://github.com/elithrar/http-api-d1-example/tree/main#endpoints (note that it is not an official Cloudflare project: it’s just an example)

GitHub

GitHub - elithrar/http-api-d1-example: An example HTTP API for Clou...

An example HTTP API for Cloudflare's D1 database: https://developers.cloudflare.com/d1/

GitHub - elithrar/http-api-d1-example: An example HTTP API for Cloudflare's D1 database: ht...

MMatt Silverlock It’s in the README: https://github.com/elithrar/http-api-d1-example/tree/main#en...

S

Samantas5855•10/14/23, 12:38 PM

I mean is it documented on official cloudflare docs?

S

Samantas5855•10/14/23, 12:38 PM

if not, why?

SSamantas5855 I mean is it documented on official cloudflare docs?

M

Matt SilverlockOP•10/14/23, 12:41 PM

All API methods are here: https://developers.cloudflare.com/d1/platform/client-api/#batch-statements

D1 client API · Cloudflare D1 docs

As part of our Client API, both static and prepared statements are supported. Best practice is to use prepared statements which are precompiled …

SSamantas5855 I mean is it documented on official cloudflare docs?

M

Matt SilverlockOP•10/14/23, 12:42 PM

No methods are undocumented. If the docs aren’t helpful, open a PR on the docs repository so we can improve them

C

Cyb3r-Jak3•10/14/23, 12:43 PM

Seems like there is confusion on Worker API and REST API methods/endpoints

C

Cyb3r-Jak3•10/14/23, 12:47 PM

@Samantas5855 The

/query/batch

/query/batch

/query/batch

/query/batch endpoint exists for the worker because it calls the

.batch

.batch

.batch

.batch method through the Workers API. All of the endpoints in the worker are just ways to access the Workers API bindings

CCyb3r-Jak3 @Samantas5855 The `/query/batch` endpoint exists for the worker because it calls...

S

Samantas5855•10/14/23, 12:49 PM

So if a method on the worker api existed named db.foobar() then the endpoint /query/foobar would also exist?

SSamantas5855 also would it be possible to do ```sql INSERT INTO table (channel, title, start_...

S

Samantas5855•10/14/23, 12:49 PM

also I was able to do that

SSamantas5855 So if a method on the worker api existed named db.foobar() then the endpoint /qu...

C

Cyb3r-Jak3•10/14/23, 12:51 PM

If the worker was written that way then yes. The endpoints in the worker can be set to whatever as it just translations from a REST to the Workers binding

S

Samantas5855•10/14/23, 12:51 PM

by calling the query api like that

  --data '{
    "params": [
        "a",
        "b",
        "c",
        "d",
        "e",
        "a2",
        "b2",
        "c2",
        "d2",
        "e2"
    ],
    "sql": "INSERT INTO myTable (f1, f2, f3, f4, f5) VALUES (?, ?, ?, ?, ?), (?, ?, ?, ?, ?);"
}'

  --data '{
    "params": [
        "a",
        "b",
        "c",
        "d",
        "e",
        "a2",
        "b2",
        "c2",
        "d2",
        "e2"
    ],
    "sql": "INSERT INTO myTable (f1, f2, f3, f4, f5) VALUES (?, ?, ?, ?, ?), (?, ?, ?, ?, ?);"
}'

  --data '{
    "params": [
        "a",
        "b",
        "c",
        "d",
        "e",
        "a2",
        "b2",
        "c2",
        "d2",
        "e2"
    ],
    "sql": "INSERT INTO myTable (f1, f2, f3, f4, f5) VALUES (?, ?, ?, ?, ?), (?, ?, ?, ?, ?);"
}'

  --data '{
    "params": [
        "a",
        "b",
        "c",
        "d",
        "e",
        "a2",
        "b2",
        "c2",
        "d2",
        "e2"
    ],
    "sql": "INSERT INTO myTable (f1, f2, f3, f4, f5) VALUES (?, ?, ?, ?, ?), (?, ?, ?, ?, ?);"
}'

MMatt Silverlock Which specific limits? Per database (2GB) will increase for everyone during the ...

P

Paul•10/14/23, 1:03 PM

Can you share with us what the new limit will be when it’s increased?

S

Samantas5855•10/14/23, 2:36 PM

https://developers.cloudflare.com/d1/platform/limits/

Maximum arguments per SQL function    32

Maximum arguments per SQL function    32

Why only 32? Is this limit going to get bigger?

Limits · Cloudflare D1 docs

Many of these limits will increase during D1’s public beta. Join the #d1-beta channel in the Cloudflare Developer Discord or subscribe to D1’s public …

SSamantas5855 https://developers.cloudflare.com/d1/platform/limits/ ``` Maximum arguments per ...

I

Isaac McFadyen•10/14/23, 2:58 PM

SQLite actually recommends a maximum of 8 for high security deployments (i.e Cloudflare D1) so I expect 32 is the maximum they will go, since that's fairly generous already.

SSamantas5855 https://developers.cloudflare.com/d1/platform/limits/ ``` Maximum arguments per ...

M

Michał•10/14/23, 3:01 PM

In what case do you need more than that?

MMatt Silverlock Yes: https://github.com/elithrar/http-api-d1-example/blob/d5c1eaaac12ef1d3e1d68c...

S

Samantas5855•10/14/23, 3:05 PM

I tried making a request to /query/batch and I get page not found

U

Up•10/14/23, 3:46 PM

anyone know what I'm doing wrong when trying to dump my DB?

const dump = await c.env.DB.dump();
    return new Response(dump, {
        status: 200,
        headers: {
            'Content-Type': 'application/octet-stream',
            'Content-Disposition': 'attachment; filename="sqlite.db"',
        }
    });

const dump = await c.env.DB.dump();
    return new Response(dump, {
        status: 200,
        headers: {
            'Content-Type': 'application/octet-stream',
            'Content-Disposition': 'attachment; filename="sqlite.db"',
        }
    });

const dump = await c.env.DB.dump();
    return new Response(dump, {
        status: 200,
        headers: {
            'Content-Type': 'application/octet-stream',
            'Content-Disposition': 'attachment; filename="sqlite.db"',
        }
    });

const dump = await c.env.DB.dump();
    return new Response(dump, {
        status: 200,
        headers: {
            'Content-Type': 'application/octet-stream',
            'Content-Disposition': 'attachment; filename="sqlite.db"',
        }
    });

running locally, getting a

D1_DUMP_ERROR: Status + 404

D1_DUMP_ERROR: Status + 404

when I call that endpoint

U

Up•10/14/23, 4:24 PM

CCyb3r-Jak3 @Samantas5855 The `/query/batch` endpoint exists for the worker because it calls...

S

Samantas5855•10/14/23, 5:27 PM

regarding that, it doesn't seem to exist anymore

S

Samantas5855•10/14/23, 5:28 PM

unless I'm doing something wrong?

MMatt Silverlock Note that if you're using DBeaver: I don't think it supports D1. Local SQLite !=...

P

Paul•10/14/23, 7:52 PM

are there any GUI clients we can use to view the local .wrangler/ D1?

SSamantas5855 I tried making a request to /query/batch and I get page not found

M

Matt SilverlockOP•10/14/23, 8:09 PM

I think you’re mixing up a standalone example with D1’s official API. I strongly recommend slowing down a tad and reading the docs:

SSamantas5855 I tried making a request to /query/batch and I get page not found

M

Matt SilverlockOP•10/14/23, 8:09 PM

The example you are referring to has nothing to do with D1’s official REST API.

M

Matt SilverlockOP•10/14/23, 8:11 PM

I invite folks to open GitHub issues so we can understand where/why they are running into limits -> allows us to increase them where it makes sense to. It’s not “fixed” at 32, but if you’re generating 1000+ then something is likely wrong with the query. This is why we ask folks to open issues (or use the form linked in the docs)

MMatt Silverlock The example you are referring to has nothing to do with D1’s official REST API.

S

Samantas5855•10/14/23, 10:52 PM

is there any example of performning batch commands with the official d1 rest api?

S

Samantas5855•10/14/23, 10:53 PM

it's the last piece that's missing to complete the implementation

C

Cyb3r-Jak3•10/14/23, 11:17 PM

You won't get the same transaction benefits as using a worker but something like

INSERT INTO 'tablename' ('column1', 'column2') VALUES
  ('data1', 'data2'),
  ('data3', 'data4'),
  ('data5', 'data6'),
  ('data7', 'data8');`

INSERT INTO 'tablename' ('column1', 'column2') VALUES
  ('data1', 'data2'),
  ('data3', 'data4'),
  ('data5', 'data6'),
  ('data7', 'data8');`

INSERT INTO 'tablename' ('column1', 'column2') VALUES
  ('data1', 'data2'),
  ('data3', 'data4'),
  ('data5', 'data6'),
  ('data7', 'data8');`

INSERT INTO 'tablename' ('column1', 'column2') VALUES
  ('data1', 'data2'),
  ('data3', 'data4'),
  ('data5', 'data6'),
  ('data7', 'data8');`

as a statement should work. Do also keep in mind that the API has a rate limit of 1200 requests per 5 minutes which is another reason deploying your own worker as an REST endpoint is recommended

CCyb3r-Jak3 You won't get the same transaction benefits as using a worker but something like...

S

Samantas5855•10/15/23, 12:12 AM

this has a limit of 32

S

Samantas5855•10/15/23, 12:12 AM

that's why I want batch

C

Cyb3r-Jak3•10/15/23, 12:31 AM

Ah gotcha then to batch you’ll need to run the proxy worker

K

Kaique Nunes•10/15/23, 8:39 AM

can I create trigger functions in D1 ? For example, I need to auto update a counter in table B when there is a new insert in table A

CCyb3r-Jak3 Ah gotcha then to batch you’ll need to run the proxy worker

S

Samantas5855•10/15/23, 9:36 AM

Yeah but that would cost extra

S

Samantas5855•10/15/23, 9:37 AM

It would make sense if the rest api just had an endpoint for it

KKaique Nunes can I create trigger functions in D1 ? For example, I need to auto update a coun...

K

Kaique Nunes•10/15/23, 11:07 AM

nervermind, it's possible just like SQLITE.

SSamantas5855 Yeah but that would cost extra

C

Cyb3r-Jak3•10/15/23, 1:09 PM

You get 100k requests per day for free with workers.

KKaique Nunes can I create trigger functions in D1 ? For example, I need to auto update a coun...

P

Paul•10/15/23, 2:26 PM

Yep, working great too!

Y

Yasin•10/15/23, 2:34 PM

Hello Cloudflare community

. I need help accessing tables in databases. I have created a database and binded it to my worker through workers.toml file. But when I make a search in a particular table, it gives "no such table" error. Here is an image of tables in my database, "Customers" is just for test purposes.

Y

Yasin•10/15/23, 2:35 PM

app.get('/posts/:lang/:slug/comments', async c => {

    const { results } = await c.env.comDB.prepare(

app.get('/posts/:lang/:slug/comments', async c => {

    const { results } = await c.env.comDB.prepare(

app.get('/posts/:lang/:slug/comments', async c => {

    const { results } = await c.env.comDB.prepare(

app.get('/posts/:lang/:slug/comments', async c => {

    const { results } = await c.env.comDB.prepare(

SELECT name, sql FROM sqlite_master

);
        return c.text(results, 200);

}

);
        return c.text(results, 200);

}

);
        return c.text(results, 200);

}

);
        return c.text(results, 200);

}

Here I am just trying to list all tables

Y

Yasin•10/15/23, 2:36 PM

here is the response, no tables

Y

Yasin•10/15/23, 2:40 PM

I have tried deleting and recreating the database and the tables many times. It doesn't work

YYasin Hello Cloudflare community 👋 . I need help accessing tables in databases. I hav...

C

Cyb3r-Jak3•10/15/23, 2:52 PM

Wrangler dev uses local mode by default so it doesn’t use the values in the dashboard. You can add values by running the d1 execute command with the

—local

—local

flag

I

Ian•10/15/23, 3:24 PM

For database-per-user usecase, is there no dynamic binding to avoid having to modify workers binding every time a new database is added ?

IIan For database-per-user usecase, is there no dynamic binding to avoid having to mo...

C

Cyb3r-Jak3•10/15/23, 3:43 PM

Correct. That is something they want to do but isn’t possible currently.

CCyb3r-Jak3 Correct. That is something they want to do but isn’t possible currently.

I

Ian•10/15/23, 3:43 PM

perhaps having somehting like "database-group"

I

Ian•10/15/23, 3:44 PM

well, i'll keep waiting for updates i guess

CCyb3r-Jak3 Wrangler dev uses local mode by default so it doesn’t use the values in the dash...

Y

Yasin•10/15/23, 4:00 PM

Nothing has changed unfortunately

YYasin Nothing has changed unfortunately

C

Cyb3r-Jak3•10/15/23, 4:03 PM

Actually looking at your code you never execute the query. You need to add

.all()

.all()

at the end of your prepare in order to use the statement

Which specific limits? Per database (2GB) will increase for everyone during the beta, but can’t be i

Similar Threads

Similar Threads

Similar Threads