Hi, is there a way to grant devs access to remote dev DB without them registering to cloudflare and

M

Hi, I am using drizzle Orm and create migration using drizzle-kit.
Can anyone tell me how can i run this to remove D1. Because for now D1 dosent show me that table.

<<Alterion.Dev>Ah, the console didn't show more than the `/help` commands and such, so it's not...

M

Max (@rozenmd)•1/15/24, 8:30 AM

this is useful feedback, will fix

C

cojo•1/15/24, 8:14 PM

Is there an easy way to confirm the SQLite version underneath D1? I couldn’t find anything on the docs. I ask because I’m curious how up to date it is kept.
In particular I’m curious if the new addition of JSONB support in today’s release can be expected to be integrated into D1 in a reasonable timeframe, or if we should expect it to lag by quarters / halves / years, if ever.

K

kian•1/15/24, 8:18 PM

It was 3.40.0 for a long time and it got bumped to 3.44.0 around November

K

kian•1/15/24, 8:20 PM

It was around 7-8 months for that bump to happen, but that's a sample size of 1 since it was introduced into the runtime as 3.40.0.

GGagan Suie Hi, is there a way to grant devs access to remote dev DB without them registerin...

G

Gagan SuieOP•1/15/24, 8:35 PM

nevermind. just going to use local.

npx wrangler d1 execute deebee --local --file=./schema.sql

npx wrangler d1 execute deebee --local --file=./schema.sql

npx wrangler d1 execute deebee --local --file=./schema.sql

npx wrangler d1 execute deebee --local --file=./schema.sql

A

Arturo•1/16/24, 12:39 AM

Hey guys, I'm trying to setup D1 on my wrangler on an existing proxy worker that I have this:

main = "worker.ts"
account_id = "123" # Cloudflare account id
compatibility_date = "2023-10-13"

[env.prod]
name = "road2crypto-router-prod"
routes = [
    { pattern = "api.road2crypto.com", custom_domain = true }
]

[env.dev]
name = "road2crypto-router-dev"
routes = [
    { pattern = "api.dev.road2crypto.com", custom_domain = true }
]

main = "worker.ts"
account_id = "123" # Cloudflare account id
compatibility_date = "2023-10-13"

[env.prod]
name = "road2crypto-router-prod"
routes = [
    { pattern = "api.road2crypto.com", custom_domain = true }
]

[env.dev]
name = "road2crypto-router-dev"
routes = [
    { pattern = "api.dev.road2crypto.com", custom_domain = true }
]

main = "worker.ts"
account_id = "123" # Cloudflare account id
compatibility_date = "2023-10-13"

[env.prod]
name = "road2crypto-router-prod"
routes = [
    { pattern = "api.road2crypto.com", custom_domain = true }
]

[env.dev]
name = "road2crypto-router-dev"
routes = [
    { pattern = "api.dev.road2crypto.com", custom_domain = true }
]

main = "worker.ts"
account_id = "123" # Cloudflare account id
compatibility_date = "2023-10-13"

[env.prod]
name = "road2crypto-router-prod"
routes = [
    { pattern = "api.road2crypto.com", custom_domain = true }
]

[env.dev]
name = "road2crypto-router-dev"
routes = [
    { pattern = "api.dev.road2crypto.com", custom_domain = true }
]

I tried adding this in a new line:

[[env.dev.d1_databases]]
binding = "DB" # i.e. available in your Worker on env.DB
database_name = "road2crypto-db"
database_id = "123"

[[env.dev.d1_databases]]
binding = "DB" # i.e. available in your Worker on env.DB
database_name = "road2crypto-db"
database_id = "123"

[[env.dev.d1_databases]]
binding = "DB" # i.e. available in your Worker on env.DB
database_name = "road2crypto-db"
database_id = "123"

[[env.dev.d1_databases]]
binding = "DB" # i.e. available in your Worker on env.DB
database_name = "road2crypto-db"
database_id = "123"

but it says:

✘ [ERROR] A request to the Cloudflare API (/accounts/123/workers/scripts/road2crypto-router-dev) failed.

  D1 bindings require module-format workers. [code: 10021]

✘ [ERROR] A request to the Cloudflare API (/accounts/123/workers/scripts/road2crypto-router-dev) failed.

  D1 bindings require module-format workers. [code: 10021]

✘ [ERROR] A request to the Cloudflare API (/accounts/123/workers/scripts/road2crypto-router-dev) failed.

  D1 bindings require module-format workers. [code: 10021]

✘ [ERROR] A request to the Cloudflare API (/accounts/123/workers/scripts/road2crypto-router-dev) failed.

  D1 bindings require module-format workers. [code: 10021]

How can I bind it?
Thanks

K

kian•1/16/24, 12:40 AM

Is

worker.ts

worker.ts

worker.ts

worker.ts using

addEventListener

addEventListener

addEventListener

addEventListener or

export default

export default

export default

export default?

A

Arturo•1/16/24, 12:40 AM

worker.ts

A

Arturo•1/16/24, 12:43 AM

If I add the name like this

[[d1_databases]]

[[d1_databases]]

[[d1_databases]]

[[d1_databases]] it then displayes a warning saying that I have to attach

env.dev

env.dev

env.dev

env.dev to it, but it doesn't bind it anyway

A

Arturo•1/16/24, 12:53 AM

ah excuse my ignorance lol, it would be event listener:

addEventListener("fetch", (event: FetchEvent) => {
    event.respondWith(handleRequest(event.request));
});

async function handleRequest(request: Request): Promise<Response> {
    

    return handleResponse(request);
}

addEventListener("fetch", (event: FetchEvent) => {
    event.respondWith(handleRequest(event.request));
});

async function handleRequest(request: Request): Promise<Response> {
    

    return handleResponse(request);
}

addEventListener("fetch", (event: FetchEvent) => {
    event.respondWith(handleRequest(event.request));
});

async function handleRequest(request: Request): Promise<Response> {
    

    return handleResponse(request);
}

addEventListener("fetch", (event: FetchEvent) => {
    event.respondWith(handleRequest(event.request));
});

async function handleRequest(request: Request): Promise<Response> {
    

    return handleResponse(request);
}

A

Arturo•1/16/24, 12:53 AM

This is a proxy I use for my other api requests I was hoping to reuse it and just add another path for the D1

P

Patrick•1/16/24, 1:09 AM

Just migrated my pages function storage from KV to D1, looking dope y'all, love it

Original message was deleted

A

Arturo•1/16/24, 1:22 AM

thanks, I think I'm going to have to create a new worker for D1 interaction because the ES module syntax is breaking some changes of the proxy such as retrieving secrets.
Thanks for the help, I'll give the tutorial a try
Update: I was able to connect it to a new worker, it's a shame I couldn't reuse the old one without overhead :/

V

villainy•1/16/24, 12:47 PM

has anyone tried inserting a very large table into D1? i just get stuck in this stage:

V

villainy•1/16/24, 12:48 PM

its been like this for 20 or so min

V

villainy•1/16/24, 12:48 PM

cant really tell if its stuck or doing something

V

villainy•1/16/24, 12:48 PM

would love some more logging.

sql file is 400mb for context

V

villainy•1/16/24, 1:41 PM

nvm found the limits:
https://developers.cloudflare.com/d1/platform/limits/

V

villainy•1/16/24, 1:41 PM

guess il switch to Turso

D

disaster.js•1/16/24, 2:23 PM

Is spellfix1 unsupported? I'm getting 'not authorized' error message

M

Max (@rozenmd)•1/16/24, 2:27 PM

unsupported:

The spellfix1 virtual table is not included in the SQLite amalgamation and is not a part of any standard SQLite build

W

wadefletch•1/16/24, 4:03 PM

Is full text search actually supported? Hoping to avoid an elastic instance and keep everything serverless, but I can't find any reference to it aside from this landing page.
https://www.cloudflare.com/developer-platform/d1/

Cloudflare

Build a natively serverless SQL database with Cloudflare D1 | Cloud...

Create a natively serverless SQL database in seconds with D1. With a familiar query language, point-in-time recovery, and cost-effective pricing you are empowered to build the next big thing.

MMax (@rozenmd)unsupported: > The spellfix1 virtual table is not included in the SQLite amalga...

D

disaster.js•1/16/24, 4:15 PM

Ohhhh woops didn't see that

N

nob•1/16/24, 7:45 PM

Since D1 supports up to 50,000 databases, is there an API to dynamically create a db and binding for a worker? There is a rest API for this but I'm wondering if there is an accepted way of doing this from a worker.

K

kian•1/16/24, 7:57 PM

Not currently

Nnob Since D1 supports up to 50,000 databases, is there an API to dynamically create ...

V

Vy•1/16/24, 7:58 PM

not yet, it's something we're designing at the moment

N

nob•1/16/24, 8:20 PM

@kian @Vy Thanks for a quick reply! Is it ok if I use the rest api from a worker to do this for the time being?

J

jeremy•1/16/24, 8:29 PM

Hey, everyone. I am working through the Next.js tutorial. I am trying to set it up on Cloudflare Pages. I am at a step where I need to hook up a database. (I'll turn this into a thread and then ask my question.)

Nnob @kian @Vy Thanks for a quick reply! Is it ok if I use the rest api from a worker...

M

Max (@rozenmd)•1/16/24, 8:33 PM

Yep, that's how folks have been doing it

M

Max (@rozenmd)•1/16/24, 8:33 PM

rather, using the api to update their bindings dynamically

N

nob•1/16/24, 8:37 PM

@Max (@rozenmd) Gotcha, thanks!

L

Ln_north•1/17/24, 12:27 AM

I'm using Next.js created with create-next-app. When I start Next with commands like

yarn dev

yarn dev

, I want to use a local D1 created with

npx wrangler d1 somecommand --local

npx wrangler d1 somecommand --local

npx wrangler d1 somecommand --local

npx wrangler d1 somecommand --local in

api/foo/bar/route.ts

api/foo/bar/route.ts

api/foo/bar/route.ts

api/foo/bar/route.ts. However, even after referring to the following page, I can't seem to bind it properly in my local environment.
https://developers.cloudflare.com/pages/framework-guides/deploy-a-nextjs-site/#use-bindings-in-your-nextjs-application
Is this an issue unique to my environment? Is there any way to fix this?

Deploy a Next.js site · Cloudflare Pages docs

Next.js is an open-source React framework for creating websites and applications. In this guide, you will create a new Next.js application and deploy …

Vvillainy has anyone tried inserting a very large table into D1? i just get stuck in this ...

A

Arma•1/17/24, 10:22 AM

Yeah my database is about 150 MB in one big table, I inserted everything with

wrangler d1 execute

wrangler d1 execute

wrangler d1 execute

wrangler d1 execute like you did

A

Arma•1/17/24, 10:23 AM

I made a SQL file with CREATE TABLE ... ; INSERT ... ; INSERT ... ; etc

A

Arma•1/17/24, 10:23 AM

a few million statements and a few hundred gigabytes

A

Arma•1/17/24, 10:24 AM

It worked fine, wrangler batched the statements and ran them without error

A

Arma•1/17/24, 10:24 AM

it took a while, as you would expect

A

Arma•1/17/24, 10:25 AM

The "Mapping SQL input into an array of statements" step took less than a minute

A

Arma•1/17/24, 10:26 AM

but it used a LOT of memory

A

Arma•1/17/24, 10:26 AM

was not an issue on my machine (16GB) but maybe something that can be improved by the wrangler devs

A

Arma•1/17/24, 10:27 AM

Make sure you separate your statements with a newline, and terminate each statement with a

;

CCyb3r-Jak3 What does the meta of the D1 result give for timing?

A

Arma•1/17/24, 10:49 AM

I've got the "cold start" again. Here are the details:

The whole request took 3960ms from the client end. I made one read on KV and executed two queries on D1. Only the first D1 query was slow, it took 3240ms. The KV read took 32ms and the second D1 query took 33ms. All of them measured in the worker with Date.now() before and after the

await

await

.

meta of the slow query:

{"served_by":"v3-prod","duration":0.6271,"changes":0,"last_row_id":0,"changed_db":false,"size_after":144568320,"rows_read":1,"rows_written":0}

{"served_by":"v3-prod","duration":0.6271,"changes":0,"last_row_id":0,"changed_db":false,"size_after":144568320,"rows_read":1,"rows_written":0}

{"served_by":"v3-prod","duration":0.6271,"changes":0,"last_row_id":0,"changed_db":false,"size_after":144568320,"rows_read":1,"rows_written":0}

{"served_by":"v3-prod","duration":0.6271,"changes":0,"last_row_id":0,"changed_db":false,"size_after":144568320,"rows_read":1,"rows_written":0}

A

Arma•1/17/24, 10:59 AM

I guess if you're not using the database for a while, it gets unloaded, and the whole thing needs to be read from disk and loaded on the next query?

AArma I guess if you're not using the database for a while, it gets unloaded, and the ...

M

Max (@rozenmd)•1/17/24, 11:53 AM

pretty much, yeah

A

Arma•1/17/24, 2:56 PM

Maybe I should split up my databases then

A

Arma•1/17/24, 2:57 PM

and put the big fat table on its own database, this way I can query other tables without waiting as much

Hi, is there a way to grant devs access to remote dev DB without them registering to cloudflare and

Similar Threads

Similar Threads

Similar Threads