Cloudflare Developers•3y ago

maybe I need use worker

MMrXO maybe I need use worker

itsmatteomanf•10/11/23, 9:02 AM

This, yes.

MMrXO took 0.2s to insert a row via API, so slow

itsmatteomanf•10/11/23, 9:03 AM

The insert didn't take 200ms, the full API request did have a 200ms roundtrip+processing time.

MrXOOP•10/11/23, 9:03 AM

yes

itsmatteomanf•10/11/23, 9:03 AM

The time to insert I presume is returned in the metadata along with the query results (I assume, never used that API myself)

Iitsmatteomanf The time to insert I presume is returned in the metadata along with the query re...

MrXOOP•10/11/23, 9:04 AM

correct

MrXOOP•10/11/23, 9:04 AM

I did not work with worker before

MrXOOP•10/11/23, 9:05 AM

so basically we build worker handler d1 query - and use python call to the worker, is it right?

itsmatteomanf•10/11/23, 9:05 AM

Yeah, exactly

Aandyt I have setup my local D1 using wrangler and --local, I have inserted a row and c...

Paolo•10/11/23, 9:05 AM

did you migrate the local DB?

MrXOOP•10/11/23, 9:06 AM

ok lets me try

MMrXO ok lets me try

itsmatteomanf•10/11/23, 9:06 AM

Be careful with SQL injections...

MrXOOP•10/11/23, 9:06 AM

MrXOOP•10/11/23, 9:06 AM

sure

PPaolo did you migrate the local DB?

andyt•10/11/23, 9:33 AM

no, I have created the same table on both local and remote

andyt•10/11/23, 9:41 AM

also when I create a migration it is empty

Paolo•10/11/23, 9:45 AM

well, you can seed the migration if you want

Paolo•10/11/23, 9:45 AM

beside

Aandyt no, I have created the same table on both local and remote

Paolo•10/11/23, 9:46 AM

what does

wrangler d1 execute DB --local --command "select * from company"

wrangler d1 execute DB --local --command "select * from company"

return?

andyt•10/11/23, 9:46 AM

the row i inserted

Aandyt the row i inserted

Paolo•10/11/23, 9:47 AM

can I have a look at the toml file? also, are you using pages or workers?

andyt•10/11/23, 10:04 AM

Looking at my db on the web site, it says I have two tables but clearly only have 1

Aandyt Looking at my db on the web site, it says I have two tables but clearly only hav...

Paolo•10/11/23, 10:24 AM

that is also a bug I found. it mysteriously vanished on its own after a while

GuillaumeLakano•10/11/23, 10:29 AM

Hi! With the future system of dynamic binding ( without explicit name in wrangler.toml ), will you permit us to connect only with the name of the database, or this will be only with the UUID value ?
I need to known if I need to store somewhere (KV, DO, D1...) an association table between the databases names and their UUID.

roftt•10/11/23, 11:50 AM

When I call D1's REST API directly like: https://api.cloudflare.com/client/v4
/accounts/{account-identifier}/d1/database/{database-identifier}/query
Do I automatically trigger a Worker call? So the pricing counts as Worker request + D1 rows read?

Rroftt When I call D1's REST API directly like: https://api.cloudflare.com/client/v4 /a...

Max (@rozenmd)•10/11/23, 11:52 AM

D1's REST API doesn't involve a Worker, which is why it's considerably slower

Max (@rozenmd)•10/11/23, 11:52 AM

you just pay for the rows read/written

Dudu•10/11/23, 12:02 PM

Can we not set default values for a certain column?

Dudu•10/11/23, 12:05 PM

I have this

status text NOT NULL DEFAULT 'active'

status text NOT NULL DEFAULT 'active'

assuming that the status would default to active but it's not working, I could swear this worked in the past but I'm having issues right now

DDudu I have this `status text NOT NULL DEFAULT 'active'` assuming that the status wou...

Max (@rozenmd)•10/11/23, 12:06 PM

you have to insert null for DEFAULT to work

Max (@rozenmd)•10/11/23, 12:06 PM

(i think)

MMax (@rozenmd)you have to insert null for DEFAULT to work

Dudu•10/11/23, 12:08 PM

isn't it what this does on the UI?

Dudu•10/11/23, 12:09 PM

I mean the issues I'm having is with the CF ui, didn't try yet on my worker, let me check

Dudu•10/11/23, 12:13 PM

Yep it's just UI, works on console

MMax (@rozenmd)D1's REST API doesn't involve a Worker, which is why it's considerably slower

roftt•10/11/23, 12:14 PM

Got it, thanks! And if I want rate limiting functionality for my D1 database, I have to use a Worker, correct?

Rroftt Got it, thanks! And if I want rate limiting functionality for my D1 database, I ...

Max (@rozenmd)•10/11/23, 12:16 PM

Yeah

DDudu I mean the issues I'm having is with the CF ui, didn't try yet on my worker, let...

Max (@rozenmd)•10/11/23, 12:16 PM

do you have a quick create table statement i can run to repro the issue?

Dudu•10/11/23, 12:19 PM

oh wait

Dudu•10/11/23, 12:19 PM

CREATE TABLE IF NOT EXISTS licenses (
  id integer PRIMARY KEY AUTOINCREMENT,
  status text NOT NULL DEFAULT 'active',
  plan text NOT NULL DEFAULT 'basic',
  created_at DATETIME DEFAULT CURRENT_TIMESTAMP,
  expires_at DATETIME DEFAULT CURRENT_TIMESTAMP
);

CREATE TABLE IF NOT EXISTS licenses (
  id integer PRIMARY KEY AUTOINCREMENT,
  status text NOT NULL DEFAULT 'active',
  plan text NOT NULL DEFAULT 'basic',
  created_at DATETIME DEFAULT CURRENT_TIMESTAMP,
  expires_at DATETIME DEFAULT CURRENT_TIMESTAMP
);

Max (@rozenmd)•10/11/23, 12:22 PM

ah I see the bug, in the console you can

insert licenses (id) values (1);

insert licenses (id) values (1);

while the dash ui is trying to run this:

{"sql":"INSERT INTO [licenses] (\"id\", \"status\", \"plan\", \"created_at\", \"expires_at\") VALUES ($0,$1,$2,$3,$4)","params":["2",null,null,null,null]}

{"sql":"INSERT INTO [licenses] (\"id\", \"status\", \"plan\", \"created_at\", \"expires_at\") VALUES ($0,$1,$2,$3,$4)","params":["2",null,null,null,null]}

Max (@rozenmd)•10/11/23, 12:23 PM

added it to our backlog, cheers

Dudu•10/11/23, 12:24 PM

Yeah that makes sense, glad I could help

ilsubyeega•10/11/23, 2:50 PM

will indexing some keys mostly occur that row_read_count being one?
such like

SELECT * from test WHERE id=100

SELECT * from test WHERE id=100

returns

"rows_read": 1

"rows_read": 1

from 150-row table at this moment.

ilsubyeega•10/11/23, 2:53 PM

also dunno where to feedback, but just wanting to say maybe adding meta data from query in dash.cloudflare.com would be better (currently doesn't show, needed to open devtools and insepct the response)

kian•10/11/23, 3:15 PM

If you prefix your query with

EXPLAIN QUERY PLAN

EXPLAIN QUERY PLAN

, you'll see that your index on

id

id

results in

SEARCH

SEARCH

being used which is only scanning a subset of tables, whereas other keys will show

SCAN

SCAN

which is a full table scan.

kian•10/11/23, 3:16 PM

kian•10/11/23, 3:17 PM

If you was more interested in the how rather than the why, https://sqlite.org/queryplanner.html is a good resource.

ilsubyeega•10/11/23, 3:18 PM

thanks i will check out when i wake up

qavi•10/11/23, 3:25 PM

Can I import mysqldump file into D1 database, or this can be possible in future?

kian•10/11/23, 3:26 PM

You'd have to find a tool that can change the MySQL flavour of SQL into SQLite.

Kkian You'd have to find a tool that can change the MySQL flavour of SQL into SQLite.

qavi•10/11/23, 3:27 PM

Ok thank you, there is no up to date tool to do this.

CREATE TABLE IF NOT EXISTS licenses ( id integer PRIMARY KEY AUTOINCREMENT, status text NOT NULL DEFAULT 'active', plan text NOT NULL DEFAULT 'basic', created_at DATETIME DEFAULT CURRENT_TIMESTAMP, expires_at DATETIME DEFAULT CURRENT_TIMESTAMP );

maybe I need use worker

Similar Threads

Similar Threads

Similar Threads