Looks like that database is indeed stuck - I've forwarded this to our internal team to take a look,

MMax (@rozenmd)Looks like that database is indeed stuck - I've forwarded this to our internal t...

S

Sej•2/22/24, 9:47 AM

Alright, thanks for the help!

RRicardas Not the nicest output here 🙂 but looks like this, i've omitted id and name ├──...

M

Max (@rozenmd)OP•2/22/24, 10:26 AM

I'll need the id to be able to look anything up about your database

RRicardas Hey is anyone else experiencing those errors: D1_ERROR: Cannot resolve D1 due to...

M

Max (@rozenmd)OP•2/22/24, 11:41 AM

and when you say high write rate, how many requests per second are we talking? >400?

K

Kosicki•2/22/24, 12:05 PM

Hey @Max (@rozenmd) any dates planned to release D1 on South America?

KKosicki Hey @Max (@rozenmd) any dates planned to release D1 on South America?

M

Max (@rozenmd)OP•2/22/24, 12:07 PM

Cloudflare doesn't give ETAs, but it'll come once DOs launch there

K

Kosicki•2/22/24, 12:07 PM

Could you give a spoiler in terms of "this year", "in five years"? something like that?

M

Max (@rozenmd)OP•2/22/24, 12:10 PM

I have no idea

T

Tony Leung•2/22/24, 1:59 PM

hi guys, it seems like D1 does not use any of my indexes

TTony Leung hi guys, it seems like D1 does not use any of my indexes

M

Max (@rozenmd)OP•2/22/24, 1:59 PM

are you using a view by any chance?

T

Tony Leung•2/22/24, 2:00 PM

well no, i don't use that feature

T

Tony Leung•2/22/24, 2:01 PM

I've created an index like

CREATE INDEX project_tiktok_link_is_empty_idx ON project (tiktok_link IS NULL OR tiktok_link == '');

CREATE INDEX project_tiktok_link_is_empty_idx ON project (tiktok_link IS NULL OR tiktok_link == '');

CREATE INDEX project_tiktok_link_is_empty_idx ON project (tiktok_link IS NULL OR tiktok_link == '');

CREATE INDEX project_tiktok_link_is_empty_idx ON project (tiktok_link IS NULL OR tiktok_link == '');

T

Tony Leung•2/22/24, 2:01 PM

and my query is like:

SELECT * FROM project WHERE id = '01HQ81GRDX539N2EJSW1ECGRMY' AND (tiktok_link IS NULL OR tiktok_link = '')

SELECT * FROM project WHERE id = '01HQ81GRDX539N2EJSW1ECGRMY' AND (tiktok_link IS NULL OR tiktok_link = '')

SELECT * FROM project WHERE id = '01HQ81GRDX539N2EJSW1ECGRMY' AND (tiktok_link IS NULL OR tiktok_link = '')

SELECT * FROM project WHERE id = '01HQ81GRDX539N2EJSW1ECGRMY' AND (tiktok_link IS NULL OR tiktok_link = '')

T

Tony Leung•2/22/24, 2:01 PM

but when i tried to

EXPLAIN QUERY PLAN

EXPLAIN QUERY PLAN

EXPLAIN QUERY PLAN

EXPLAIN QUERY PLAN

T

Tony Leung•2/22/24, 2:02 PM

the result is this:

T

Tony Leung•2/22/24, 2:02 PM

it only uses primary key index

M

Max (@rozenmd)OP•2/22/24, 2:02 PM

sqlite uses the best index where possible

T

Tony Leung•2/22/24, 2:02 PM

i tried

CREATE INDEX project_tiktok_link_is_empty_and_id_idx ON project (tiktok_link IS NULL OR tiktok_link == '', id);

CREATE INDEX project_tiktok_link_is_empty_and_id_idx ON project (tiktok_link IS NULL OR tiktok_link == '', id);

CREATE INDEX project_tiktok_link_is_empty_and_id_idx ON project (tiktok_link IS NULL OR tiktok_link == '', id);

CREATE INDEX project_tiktok_link_is_empty_and_id_idx ON project (tiktok_link IS NULL OR tiktok_link == '', id);

T

Tony Leung•2/22/24, 2:03 PM

and

CREATE INDEX project_tiktok_link_is_empty_and_id_idx ON project (tiktok_link, id);

CREATE INDEX project_tiktok_link_is_empty_and_id_idx ON project (tiktok_link, id);

CREATE INDEX project_tiktok_link_is_empty_and_id_idx ON project (tiktok_link, id);

CREATE INDEX project_tiktok_link_is_empty_and_id_idx ON project (tiktok_link, id);

T

Tony Leung•2/22/24, 2:03 PM

but none of them work

T

Tony Leung•2/22/24, 2:03 PM

i'm aware that index is left-most so i also changed my condition order but none of them work

T

Tony Leung•2/22/24, 2:04 PM

this table is large and this query is burning the

rows read

rows read

rows read

rows read

MMax (@rozenmd)sqlite uses the best index where possible

T

Tony Leung•2/22/24, 2:05 PM

well no more than one index will be used?

SSej Hi, I need help with my DB. I tried to use the time travel feature to restore so...

M

Max (@rozenmd)OP•2/22/24, 2:29 PM

can you try accessing the DB again?

F

F0rce•2/22/24, 3:45 PM

I noticed the following error / was able to reproduce it https://github.com/cloudflare/workers-sdk/issues/3160#issuecomment-1943795347 - has this been deployed yet (because the error is still open)

FF0rce I noticed the following error / was able to reproduce it <https://github.com/clo...

M

Max (@rozenmd)OP•2/22/24, 3:53 PM

It was released, where were you able to reproduce it?

MMax (@rozenmd)It was released, where were you able to reproduce it?

F

F0rce•2/22/24, 3:53 PM

D1 and using Drizzle.

F

F0rce•2/22/24, 3:53 PM

so it could be an drizzle error / they didnt update their part yet

M

Max (@rozenmd)OP•2/22/24, 3:53 PM

D1 as in through a Worker, or via wrangler d1 execute?

F

F0rce•2/22/24, 3:53 PM

through a worker

M

Max (@rozenmd)OP•2/22/24, 3:54 PM

using

.raw()

.raw()

.raw()

.raw()?

F

F0rce•2/22/24, 3:54 PM

I dont know what drizzle uses at the end, 1 sec let me check

M

Max (@rozenmd)OP•2/22/24, 3:54 PM

Oh, yeah they'd need to update on their end

F

F0rce•2/22/24, 3:55 PM

probably they are not using

.raw()

.raw()

.raw()

.raw()

M

Max (@rozenmd)OP•2/22/24, 3:55 PM

To include an array of column names in the results when using raw(), use
raw({columnNames: true})
raw({columnNames: true})
raw({columnNames: true})
raw({columnNames: true}).

F

F0rce•2/22/24, 3:55 PM

ahhhh let me bump the issue on their end again, sorry for the false alarm

F

F0rce•2/22/24, 3:55 PM

thanks for the fast answer

M

Max (@rozenmd)OP•2/22/24, 4:00 PM

Actually let me double check with the workerd team internally

FF0rce ahhhh let me bump the issue on their end again, sorry for the false alarm

M

Max (@rozenmd)OP•2/22/24, 4:12 PM

It's on us actually, it's live in main but not released in the workerd package + workers-types

F

F0rce•2/22/24, 4:13 PM

wait, so the fix has not been released yet ?

F

F0rce•2/22/24, 4:13 PM

and thats probably why the issue is still open ?

M

Max (@rozenmd)OP•2/22/24, 4:13 PM

if you use raw directly, you're interacting with the live runtime, which has the fix

M

Max (@rozenmd)OP•2/22/24, 4:14 PM

we reopened that issue because the workers-types package hasn't been bumped yet

F

F0rce•2/22/24, 4:14 PM

thats probably why it hasent been fixed in drizzle yet, because they wait for the types

F

F0rce•2/22/24, 4:14 PM

as the latest comment in the issue states

F

F0rce•2/22/24, 4:15 PM

then is there an ETA on when the package & types will be bumped ?

M

Max (@rozenmd)OP•2/22/24, 4:15 PM

I've nudged the workerd folks for a release

Looks like that database is indeed stuck - I've forwarded this to our internal team to take a look,

Similar Threads

Similar Threads

Similar Threads