How are you getting your results from queries? - Cloudflare Developers

© 2026 Hedgehog Software, LLC

More

Communities Docs About Terms Privacy

Paul

PPaul How are you getting your results from queries?

kian

K

kian•11/7/23, 4:17 PM

Use another method, like

all()

all()

or

first()

first()

.

Paul

P

PaulOP•11/7/23, 4:18 PM

wow, thats insane. so my intellisense is just wrong

Paul

P

PaulOP•11/7/23, 4:18 PM

or was this a recent change?

Paul

P

PaulOP•11/7/23, 4:19 PM

and how the heck are all my other queries working then

Paul

P

PaulOP•11/7/23, 4:19 PM

haha

Paul

P

PaulOP•11/7/23, 4:19 PM

i use run() everywhere

Paul

P

PaulOP•11/7/23, 4:19 PM

maybe because they are simple SELECT statements?

kian

K

kian•11/7/23, 4:32 PM

run()

run()

should throw an error if it returns results.

kian

K

kian•11/7/23, 4:33 PM

Well, it did in Wrangler 3.1.1. Seems like it doesn't in 3.15.0.

kian

K

kian•11/7/23, 4:34 PM

@rozenmd is the documentation wrong about

run()

run()

? It currently does exactly the same as

all()

all()

.

Paul

P

PaulOP•11/7/23, 4:36 PM

yep that exactly. It looks like my problem is unrelated to D1. It seems the worker function is running twice, so the first one is eating the verification_token, and the second run fails.

Max (@rozenmd)

M

Max (@rozenmd)•11/7/23, 4:56 PM

i don't recall us changing

run()

run()

's behaviour tbh

johnjoz

J

johnjoz•11/7/23, 6:24 PM

D1 workers paid noob possible: trying to upload a roughly 1.5 gb database with wrangler fails with mysterious node errors, and I’ve followed the sundry blog examples. I can rclone to r2 with impunity. Is there any facility to load a d1 sqlite db from r2?

Max (@rozenmd)

MMax (@rozenmd)i don't recall us changing `run()`'s behaviour tbh

kian

K

kian•11/7/23, 6:28 PM

I've tried it in local & remote development and

run()

run()

returns

results

results

.

kian

K

kian•11/7/23, 6:28 PM

In Wrangler 3.1.1, you'd get an error thrown saying "Execute returned results" or something similar

kian

K

kian•11/7/23, 6:29 PM

kian

K

kian•11/7/23, 6:29 PM

kian

K

kian•11/7/23, 6:33 PM

Miniflare used to check on it's own and throw (hence why I had the issue on an old Wrangler version) but now the API seems to send results rather than an error.

johnjoz

Jjohnjoz D1 workers paid noob possible: trying to upload a roughly 1.5 gb database with w...

Max (@rozenmd)

M

Max (@rozenmd)•11/7/23, 8:16 PM

you might be overloading the db - what exactly are the errors?

johnjoz

J

johnjoz•11/7/23, 8:57 PM

% wrangler d1 execute ipbistrosql --file ./searchtree.sql
FATAL ERROR: v8::ToLocalChecked Empty MaybeLocal

johnjoz

J

johnjoz•11/7/23, 8:57 PM

Plus many more nondescript lines from v8 and node

johnjoz

J

johnjoz•11/7/23, 8:59 PM

If i copy the sql file and truncate at a hundred lines that works as in blogs. But of course is useless. The sql file (generated by dump from sqlite3 file tested locally) is about 21 million lines. The db is about 1.5 gb.

johnjoz

J

johnjoz•11/7/23, 9:06 PM

Perhaps I should rclone the sql file to r2 (i can do that no problem) then write a worker which loads from r2 into d1, but it seems i hit some unintended unchecked limit inside a node dependency or v8 itself (on which i was long ago a contributor via a qualcomm google joint effort)

johnjoz

Jjohnjoz % wrangler d1 execute ipbistrosql --file ./searchtree.sql FATAL ERROR: v8::ToLoc...

Matt Silverlock

M

Matt Silverlock•11/7/23, 9:12 PM

What is your account ID & database ID?

johnjoz

J

johnjoz•11/7/23, 9:23 PM

johnjoz

J

johnjoz•11/7/23, 9:24 PM

1b4eb314bfee79ccebd94f33e9bde8ee

johnjoz

J

johnjoz•11/7/23, 9:24 PM

d6ac38a9-20be-4fb4-9839-02a379d944da

johnjoz

J

johnjoz•11/7/23, 9:25 PM

That says uuid on the wrangler output for d1 list

johnjoz

J

johnjoz•11/7/23, 9:29 PM

I did upload the sqlite3 file to r2 but not the sql dump script

johnjoz

Jjohnjoz Click to see attachment

Matt Silverlock

M

Matt Silverlock•11/7/23, 9:38 PM

This is wrangler failing to parse 1.5GB locally. As an interim fix, you'll need to break up the upload into smaller chunks.

johnjoz

J

johnjoz•11/7/23, 9:40 PM

Thank you

Victor

V

Victor•11/8/23, 12:25 AM

Does the sqlite engine inside D1 not support

unhex()

unhex()

?

Victor

V

Victor•11/8/23, 12:26 AM

Since it's listed here as a core function https://www.sqlite.org/lang_corefunc.html#unhex

Victor

V

Victor•11/8/23, 12:28 AM

Which I find weird because

hex()

hex()

works just fine

kian

K

kian•11/8/23, 12:32 AM

do you get not authorized or an error about it not existing

Victor

V

Victor•11/8/23, 12:32 AM

If I have a uuid stored as binary

BLOB

BLOB

(initially generated with

(randomblob(16))

(randomblob(16))

), this works:

(lower(format('%s-%s-%s-%s-%s', substr(hex(t_id),1,8), substr(hex(t_id),9,4), substr(hex(t_id),13,4), substr(hex(t_id),17,4), substr(hex(t_id),21))))

(lower(format('%s-%s-%s-%s-%s', substr(hex(t_id),1,8), substr(hex(t_id),9,4), substr(hex(t_id),13,4), substr(hex(t_id),17,4), substr(hex(t_id),21))))

to get the normal looking utf8 uuid

kian

Kkian do you get not authorized or an error about it not existing

Victor

V

Victor•11/8/23, 12:32 AM

{
  result: [],
  success: false,
  errors: [ { code: 7500, message: 'no such function: unhex' } ],
  messages: []
}

{
  result: [],
  success: false,
  errors: [ { code: 7500, message: 'no such function: unhex' } ],
  messages: []
}

Victor

V

Victor•11/8/23, 12:35 AM

I make it

import { randomUUID } from 'node:crypto';

export class Helpers {
    public static get generateUuid() {
        const uuid = randomUUID();
        const uuidHex = uuid.replaceAll('-', '');

        return {
            utf8: uuid,
            forBlob: uuidHex,
        };
    }
}

import { randomUUID } from 'node:crypto';

export class Helpers {
    public static get generateUuid() {
        const uuid = randomUUID();
        const uuidHex = uuid.replaceAll('-', '');

        return {
            utf8: uuid,
            forBlob: uuidHex,
        };
    }
}

Then I try to insert it with

query: {
    params: [Helpers.generateUuid.forBlob],
    sql: `INSERT INTO some_table (uuid) VALUES (unhex(?))`,
}

query: {
    params: [Helpers.generateUuid.forBlob],
    sql: `INSERT INTO some_table (uuid) VALUES (unhex(?))`,
}

kian

K

kian•11/8/23, 12:37 AM

unhex isn’t in the version of SQLite that D1 currently uses

kian

Kkian unhex isn’t in the version of SQLite that D1 currently uses

Victor

V

Victor•11/8/23, 12:37 AM

what is the version of sqlite that d1 uses?

not authorized to use function: sqlite_version

not authorized to use function: sqlite_version

kian

K

kian•11/8/23, 12:42 AM

3.40.1

Victor

V

Victor•11/8/23, 12:43 AM

nooooo, the version that added it is literally the next one

3.41.0

3.41.0

Victor

V

Victor•11/8/23, 12:43 AM

Woah it even adds

base64()

base64()

too...plzzzzzz update to 3.41.0+

Victor

V

Victor•11/8/23, 12:45 AM

In that case, how can I format buffer related data through the REST api to output back as a BLOB binary buffer in D1?

Victor

VVictor 😭 nooooo, the version that added it is literally the next one `3.41.0`

kian

K

kian•11/8/23, 12:50 AM

There’s an open PR to update it to 3.44.0 so if/when that’s merged and released it’ll be available.

kian

Kkian There’s an open PR to update it to 3.44.0 so if/when that’s merged and released ...

Victor

V

Victor•11/8/23, 12:53 AM

Can you send me a link to that PR? I'm not seeing one on

cloudflare/workers-sdk

cloudflare/workers-sdk

kian

K

kian•11/8/23, 12:54 AM

The runtime is at cloudflare/workerd

kian

K

kian•11/8/23, 12:55 AM

https://github.com/cloudflare/workerd/pull/1374

Victor

V

Victor•11/8/23, 12:55 AM

lol I just found it literally same second as you sent it

Rick

R

Rick•11/8/23, 7:00 AM

Does the sqllite FTS works on D1? Also, are there any options for text search, if my data is distributed amongst all the D1 dbs in my account?

import { randomUUID } from 'node:crypto';

export class Helpers {
    public static get generateUuid() {
        const uuid = randomUUID();
        const uuidHex = uuid.replaceAll('-', '');

        return {
            utf8: uuid,
            forBlob: uuidHex,
        };
    }
}

import { randomUUID } from 'node:crypto';

export class Helpers {
    public static get generateUuid() {
        const uuid = randomUUID();
        const uuidHex = uuid.replaceAll('-', '');

        return {
            utf8: uuid,
            forBlob: uuidHex,
        };
    }
}