@malone yea Don't trust it for math @rozenmd

M

malone•10/7/23, 6:55 PM

when i gave it my schema and said "estimate how big the table would be with 3 million rows" it got it pretty spot on, said 500mb when it is 400mb (due to not taking up the full size of the columns)

M

malone•10/7/23, 6:55 PM

ymmv

M

malone•10/7/23, 6:57 PM

it estimating 1kb per row was definately a miss, im guessing it doesn't have enough context of your table schema bc that's way too high

NNikil @malone yea Don't trust it for math @rozenmd

M

malone•10/7/23, 6:57 PM

that math is correct

M

malone•10/7/23, 6:57 PM

anyway, ignore me lmao

Fforslunds If you do an insert on DB-binding. Do you want it on all DBs or just the “curren...

W

w3bcode•10/7/23, 10:18 PM

on Seperate DB depending on tenant

C

cristiandley•10/8/23, 3:39 AM

Hey Guys, i have a db and corresponding preview, but now i can't apply mirgations since it returns an error

✘ [ERROR] Can't find a DB with name/binding 'preview-mydb' in local config. Check info in wrangler.toml...

✘ [ERROR] Can't find a DB with name/binding 'preview-mydb' in local config. Check info in wrangler.toml...

but i have a definition like so

[[d1_databases]]
binding = "DB"
database_name = "mydb"
database_id = "main-id"
preview_database_id = "preview-id"

[[d1_databases]]
binding = "DB"
database_name = "mydb"
database_id = "main-id"
preview_database_id = "preview-id"

[[d1_databases]]
binding = "DB"
database_name = "mydb"
database_id = "main-id"
preview_database_id = "preview-id"

[[d1_databases]]
binding = "DB"
database_name = "mydb"
database_id = "main-id"
preview_database_id = "preview-id"

전전현우 Hi. Im trying to use Cloudflare D1 on Next.js Project. But I can't found any res...

J

James•10/8/23, 8:05 AM

You could use something like cf-bindings-proxy to access it in

next dev

next dev

A

Adi•10/8/23, 9:42 AM

The introduction of Hyperdrive got me thinking. Query caching is a very useful tool for any database. Are there plans to implement query caching in D1 at some point? Or is this something we would be expected to build ourselves?

M

Michał•10/8/23, 9:47 AM

Hi! Is global read replication already available for D1?

MMichał Hi! Is global read replication already available for D1?

H

Hello, I’m Allie!•10/8/23, 9:47 AM

Not yet

M

Michał•10/8/23, 9:48 AM

Thanks. Is there a timeline for that? Or maybe a closed alpha we could participate in?

MMichał Thanks. Is there a timeline for that? Or maybe a closed alpha we could participa...

H

Hello, I’m Allie!•10/8/23, 9:52 AM

is the only answer we can provide atm

W

w3bcode•10/8/23, 10:19 AM

Can anyone help me to access multiple D1 database from same worker ? I want to use the multiple database feature per tenant. But couldnt figure out how

Ww3bcode Can anyone help me to access multiple D1 database from same worker ? I want to u...

M

Michał•10/8/23, 10:23 AM

You should be able to add multiple bindings under different names

MMichał You should be able to add multiple bindings under different names

W

w3bcode•10/8/23, 11:24 AM

but with this, I wont be able to use same API for multitenant

I would need to deploy each worker seperately for each worker I guess.

Is there any better way to support multitenant with D1 database ?

M

Michał•10/8/23, 11:45 AM

You can have separate workers for each tenant. I'm not sure if that's the "official" way of doing things but that's how we're doing it.

MMichał You can have separate workers for each tenant. I'm not sure if that's the "offic...

W

w3bcode•10/8/23, 11:49 AM

got it. thanks

Mmalone that math is correct

N

NikilOP•10/8/23, 11:59 AM

oh yea it is huh

P

Paul•10/8/23, 3:03 PM

Is d1 production ready?

P

Paul•10/8/23, 3:16 PM

I’m super pumped to switch things off supabase

B

bkyerv•10/8/23, 3:17 PM

hello everyone, I'm encountering a problem when applying drizzle generated migrations to Cloudflare D1. The initial migration is processed without any hiccups, but I run into an issue with subsequent migrations, especially those that modify existing columns. Here's the error I'm receiving:

/*
 SQLite does not support "Changing existing column type" out of the box, we do not generate automatic migration for that, so it has to be done manually
 Please refer to: https://www.techonthenet.com/sqlite/tables/alter_table.php
                  https://www.sqlite.org/lang_altertable.html
                  https://stackoverflow.com/questions/2083543/modify-a-columns-type-in-sqlite3

 Due to that we don't generate migration automatically and it has to be done manually
*/

/*
 SQLite does not support "Changing existing column type" out of the box, we do not generate automatic migration for that, so it has to be done manually
 Please refer to: https://www.techonthenet.com/sqlite/tables/alter_table.php
                  https://www.sqlite.org/lang_altertable.html
                  https://stackoverflow.com/questions/2083543/modify-a-columns-type-in-sqlite3

 Due to that we don't generate migration automatically and it has to be done manually
*/

/*
 SQLite does not support "Changing existing column type" out of the box, we do not generate automatic migration for that, so it has to be done manually
 Please refer to: https://www.techonthenet.com/sqlite/tables/alter_table.php
                  https://www.sqlite.org/lang_altertable.html
                  https://stackoverflow.com/questions/2083543/modify-a-columns-type-in-sqlite3

 Due to that we don't generate migration automatically and it has to be done manually
*/

/*
 SQLite does not support "Changing existing column type" out of the box, we do not generate automatic migration for that, so it has to be done manually
 Please refer to: https://www.techonthenet.com/sqlite/tables/alter_table.php
                  https://www.sqlite.org/lang_altertable.html
                  https://stackoverflow.com/questions/2083543/modify-a-columns-type-in-sqlite3

 Due to that we don't generate migration automatically and it has to be done manually
*/

I feel this is related to D1 than to drizzle as applying migrations locally runs smooth and raise errors only when attempting to run migrations to remote db

Bbkyerv hello everyone, I'm encountering a problem when applying drizzle generated migra...

A

Adi•10/8/23, 3:23 PM

That looks like the output of drizzle kit and not a D1 error.

The comment it's generated is accurate. Nothing to do with D1.

B

bkyerv•10/8/23, 3:26 PM

I see. why can it then apply them locally and raise error in case remote db is attempted?

C

cfanclub•10/8/23, 3:28 PM

Is it possible to download time-travel backup locally of new d1 database using wrangler ?

M

Michał•10/8/23, 4:26 PM

Is there a way to provide the primary location hint when creating a D1 database via the API? (POST

/accounts/{account-identifier}/d1/database

/accounts/{account-identifier}/d1/database

/accounts/{account-identifier}/d1/database

/accounts/{account-identifier}/d1/database)
Right now DBs created this way get assigned to the

WNAM

WNAM

WNAM

WNAM region but I'd prefer Europe

K

kian•10/8/23, 4:34 PM

Add primary_location_hint: <loc> to the body

Kkian Add primary_location_hint: <loc> to the body

M

Michał•10/8/23, 6:58 PM

Thank you and sorry for late response. That did the trick, even though the openapi schema doesn't mention it

M

MarkB•10/8/23, 7:29 PM

hi, what is health check region in load balancing? if region is 1 in load balancing, it doesn't work for request from other regions?

N

Noel•10/8/23, 8:27 PM

I started getting

 binding __D1_BETA__DB of type d1 failed to generate. Please try again later or contact support.
  [code: 10021]

 binding __D1_BETA__DB of type d1 failed to generate. Please try again later or contact support.
  [code: 10021]

 binding __D1_BETA__DB of type d1 failed to generate. Please try again later or contact support.
  [code: 10021]

 binding __D1_BETA__DB of type d1 failed to generate. Please try again later or contact support.
  [code: 10021]

on new deploy attempts. Is it related to the current incident? https://www.cloudflarestatus.com/incidents/64wsqjxnljn3

J

James•10/8/23, 8:33 PM

Very likely, yes. I'd recommend trying again once the incident is resolved

FFerry I get the same and in the cloudflare web 'dashboard' under workers and pages/d1 ...

J

James•10/8/23, 8:42 PM

yep that one is definitely related to https://www.cloudflarestatus.com/incidents/64wsqjxnljn3. Please try again once the incident is resolved, apologies for the issues!

J

Jadugar_Jaggu•10/9/23, 7:28 AM

Hey Guys, can we cache the D1 results ? and is it production ready ?

JJadugar_Jaggu Hey Guys, can we cache the D1 results ? and is it production ready ?

M

Max (@rozenmd)•10/9/23, 7:48 AM

D1 is in public beta. While we expect breaking changes and issues to be minimal, they may still occur. We generally do not recommend running large production workloads on beta products.

from https://developers.cloudflare.com/d1/

---

Being in a Worker, you have full access to the cache API: https://developers.cloudflare.com/workers/runtime-apis/cache/

Ddpeek I have a question about prepared statements: the docs state that prepared statem...

M

Max (@rozenmd)•10/9/23, 1:52 PM

prepared statements help protect you against sql injection and improve performance when a query is re-used, as the db doesn't need to re-parse the query each time

S

shixzie•10/9/23, 3:40 PM

I'd love an option to download a copy of the database to run and test locally

C

cfanclub•10/9/23, 3:54 PM

CREATE TABLE blog (
    id TEXT PRIMARY KEY,
    created_at DATETIME DEFAULT CURRENT_TIMESTAMP,
    content_url TEXT,
    frontmatter JSON,
    slug TEXT UNIQUE,
    title TEXT,
    website_ref_id TEXT,
    FOREIGN KEY (website_ref_id) REFERENCES website(id)
);

CREATE TABLE blog (
    id TEXT PRIMARY KEY,
    created_at DATETIME DEFAULT CURRENT_TIMESTAMP,
    content_url TEXT,
    frontmatter JSON,
    slug TEXT UNIQUE,
    title TEXT,
    website_ref_id TEXT,
    FOREIGN KEY (website_ref_id) REFERENCES website(id)
);

CREATE TABLE blog (
    id TEXT PRIMARY KEY,
    created_at DATETIME DEFAULT CURRENT_TIMESTAMP,
    content_url TEXT,
    frontmatter JSON,
    slug TEXT UNIQUE,
    title TEXT,
    website_ref_id TEXT,
    FOREIGN KEY (website_ref_id) REFERENCES website(id)
);

CREATE TABLE blog (
    id TEXT PRIMARY KEY,
    created_at DATETIME DEFAULT CURRENT_TIMESTAMP,
    content_url TEXT,
    frontmatter JSON,
    slug TEXT UNIQUE,
    title TEXT,
    website_ref_id TEXT,
    FOREIGN KEY (website_ref_id) REFERENCES website(id)
);

I have the given schema in d1 database, I am using the preprare statement as

DB.prepare('select * from blog').all()

DB.prepare('select * from blog').all()

DB.prepare('select * from blog').all()

DB.prepare('select * from blog').all() But the stored frontmatter is returning json as string instead of automatically parsing it out as json.

Am I missing something ?

Ccfanclub ``` CREATE TABLE blog ( id TEXT PRIMARY KEY, created_at DATETIME DEFAULT...

M

Michał•10/9/23, 3:56 PM

SQLite stores JSON as ordinary text.

C

cfanclub•10/9/23, 3:57 PM

Ohh, so that means i would need to manually parse it to object using something like

JSON.parse()

JSON.parse()

JSON.parse()

JSON.parse() or is there any way to do this automatically ? I read somewhere, that libraries like kysley or drizzle does this automatically, but I dont want to add extra layer of code and stick to prepare statements

M

Michał•10/9/23, 3:58 PM

I think you'd need to parse it from text to json manually, yeah

K

kian•10/9/23, 4:02 PM

https://developers.cloudflare.com/d1/learning/querying-json/

Query JSON · Cloudflare D1 docs

D1 has built-in support for querying and parsing JSON data stored within a database. This enables you to:

C

Curtis Jones•10/9/23, 4:03 PM

Hi. Now that the max db size is adequate for my use, I'm testing D1 out again. I noticed that the docs still indicate a 50 byte limit for both LIKE and GLOB. I have found that to be accurate for LIKE, but GLOB does not seem to have that same limit (which is important to me). Is there a plan to impose a 50 byte limit on GLOB?

C

cfanclub•10/9/23, 4:04 PM

Yeah read through docs but this query didnt work

select id,
            content_url,
            json(frontmatter) as frontmatter,
            slug,
            title,
            website_ref_id,
            created_at
from blog

select id,
            content_url,
            json(frontmatter) as frontmatter,
            slug,
            title,
            website_ref_id,
            created_at
from blog

select id,
            content_url,
            json(frontmatter) as frontmatter,
            slug,
            title,
            website_ref_id,
            created_at
from blog

select id,
            content_url,
            json(frontmatter) as frontmatter,
            slug,
            title,
            website_ref_id,
            created_at
from blog

in prepare statement, but unfortunately that also didnt work.

CCurtis Jones Hi. Now that the max db size is adequate for my use, I'm testing D1 out again. I...

K

kian•10/9/23, 4:07 PM

Theoretically

GLOB

GLOB

GLOB

GLOB should already be limited, as

LIKE

LIKE

LIKE

LIKE &

GLOB

GLOB

GLOB

GLOB are supposed to be controlled by

SQLITE_LIMIT_LIKE_PATTERN_LENGTH

SQLITE_LIMIT_LIKE_PATTERN_LENGTH

SQLITE_LIMIT_LIKE_PATTERN_LENGTH

SQLITE_LIMIT_LIKE_PATTERN_LENGTH which is set to 50.

Kkian Theoretically `GLOB` should already be limited, as `LIKE` & `GLOB` are supposed ...

C

Curtis Jones•10/9/23, 4:10 PM

Good to know. I guess I'll enjoy D1 while I can. If this is a limit that Cloudflare can adjust individually, is there any way I can check to see if that's what's going on in my case?

@malone yea Don't trust it for math @rozenmd

Similar Threads

Similar Threads

Similar Threads