I've just take a look inside the code, and I was confused, It's not what I've thought. I need somet

I've just take a look inside the code, and I was confused, It's not what I've thought.

I need something like this Cloudflare API to create a D1 database ( and query it ) but in local mode ( offline )
https://developers.cloudflare.com/api/operations/cloudflare-d1-query-database

I suppose this is not yet possible until the feature of dynamic bindings

Cloudflare API Documentation

Interact with Cloudflare's products and services via the Cloudflare API

GGuillaumeLakano I've just take a look inside the code, and I was confused, It's not what I've th...

Hello, I’m Allie!•10/16/23, 2:36 PM

Would this work? https://github.com/elithrar/http-api-d1-example

GitHub

GitHub - elithrar/http-api-d1-example: An example HTTP API for Clou...

An example HTTP API for Cloudflare's D1 database: https://developers.cloudflare.com/d1/

GitHub - elithrar/http-api-d1-example: An example HTTP API for Cloudflare's D1 database: ht...

Hello, I’m Allie!•10/16/23, 2:37 PM

It’s not specifically made for local, but I don’t see why it shouldn’t work

HHello, I’m Allie!It’s not specifically made for local, but I don’t see why it shouldn’t work

GuillaumeLakanoOP•10/16/23, 3:20 PM

This project isn't what I needed, it's a proxy to uses a remote D1 database, and could be used with as a REST API to be hosted in local, but the database is still on CF servers (online).

In fact, I was confused with the Cloudflare API, that permit to create a D1 database and to query it through REST API too, but it's create the D1 database in CF servers too (need to be online too).

I suppose there is not an equivalent Cloudflare API to call in REST on localhost, that could permit us to create a new database (offline) inside our .wrangler/d1/ folder

GGuillaumeLakano This project isn't what I needed, it's a proxy to uses a remote D1 database, and...

Cyb3r-Jak3•10/16/23, 3:23 PM

You should be able to use miniflare for this. See https://github.com/cloudflare/miniflare/releases/tag/v3.20230918.0

GitHub

Release v3.20230918.0 · cloudflare/miniflare

What's Changed

Implement simulators as Durable Objects by @mrbbot in #656.
Allow GET requests with bodies in entry worker by @mrbbot in #677
Remove unused handleQueue() function from entry wor...

CCyb3r-Jak3 You should be able to use miniflare for this. See https://github.com/cloudflare/...

GuillaumeLakanoOP•10/16/23, 3:27 PM

Thank you, indeed there is example to access any kind of databases, ( « const d1Database = await mf.getD1Database("DATABASE");» ), I'm not sure this also permit to create one, but I'll check, thank you for the link!

GGuillaumeLakano This project isn't what I needed, it's a proxy to uses a remote D1 database, and...

mrwind•10/17/23, 1:20 AM

my project offer a self-hosted version so i create a local sqlite it doesn't depend on miniflare or cloudflare and use better-sqlite3 to run query

WWill Hackett Okay, that's all good. I would ADORE a best guess timeline if you have one. ❤️

forslunds•10/17/23, 10:14 AM

The latest dev blog about D1 says the limit will be upped coming weeks and months. (note, Several times) Once they have fast read on big sizes they would love to be on double-digit GB size. And they are aiming on GA Q1 2024. So i would guess.. "soon"

Elliot Hesp•10/17/23, 10:35 AM

Would it be expected that KV is quicker than D1 (indexed) reads?

I've got a performance sensitive worker, and I'm not sure whether adding a KV check before D1 query makes much sense or not

zegevlier•10/17/23, 10:52 AM

KV is extremely fast (faster than D1 without query caching) if the read is hot. If it's a cold read, it would probably depend on the location of you D1 database relative to the person requesting.

niconiahi•10/17/23, 1:59 PM

hey! is it possible to change the migrationsmigrations directory?

I don't want my migrations directory to be at the top of my repository, but instead in a folder dbdb, the complete location being ./db/migrations./db/migrations

in the config toml I have this configuration but it doesn't read it

migrations_dir = "db/migrations"

migrations_dir = "db/migrations"

thanks in advance

James•10/17/23, 6:20 PM

The pricing did change recently, yes, during birthday week

https://blog.cloudflare.com/d1-open-beta-is-here/#row-based-pricing

Unsmart•10/17/23, 6:40 PM

2 different pricing models is super confusing hence why they are removing the bundled/unbound models and making 1 standard pricing.

And SQL in general almost never follows denormalization as its pretty much built to normalize and support joins. But im not sure how the new billing model encourages normalization when it costs more to get 2 records via a join than it does to get 1?

Unsmart•10/17/23, 6:42 PM

Oh ok well I dont see why thats a problem? Denormalization makes it faster computationally and storage is cheaper than compute

Unsmart•10/17/23, 6:43 PM

SQL may be designed with joins in mind but denormalization is faster because of the fact it doesnt need to join.

Original message was deleted

Michał•10/17/23, 7:25 PM

Can you share any sources to support that?

Michał•10/17/23, 7:30 PM

I see, so you can't. That's what I thought, thanks for confirming!

Michał•10/17/23, 7:33 PM

This book is 20 years old and how could it even be used to prove anything when we're discussing benchmarks?

Michał•10/17/23, 7:34 PM

How would they be still valid after 20 years?

Michał•10/17/23, 7:35 PM

So can you or can you not share any benchmarks supporting the claim that joins are faster than lack of joins?

James•10/17/23, 7:37 PM

Let's keep it civil please folks

Michał•10/17/23, 7:38 PM

@bitte chill, it's okay if you can't. No worries.

kian•10/18/23, 6:25 PM

I suspect it's unlikely

kian•10/18/23, 6:25 PM

#hyperdrive-beta exists for connecting to PostgreSQL (and MySQL on the roadmap) databases

MMusfiq It would be great if we can import a PostgreSQL database in Cloudflare D1. For n...

Michał•10/18/23, 6:28 PM

The ideas behind sqlite and postgresql are incompatible. Sqlite is great for replicating on the edge, and it's cheap. Postgres not so much.

Michał•10/18/23, 7:03 PM

As far as I know D1 databases are not currently replicated to different regions so there's only primary location.
But I'm too hoping this will be added when replication is introduced.

Original message was deleted

Cyb3r-Jak3•10/18/23, 7:03 PM

Planned for GA d1-database

MAHMULA•10/19/23, 12:11 AM

hey

Old Man Maker•10/19/23, 4:44 AM

Apologies if this has been answered, but I am not able to find the answer.

If I create a D1 database using the REST api, is there anyway to then use it in an existing worker without needing to define the Binding at design time? I.e, is it possible to create a dynamic binding to a D1 inside a worker at runtime?

Michał•10/19/23, 6:32 AM

You can update bindings via rest api after you create the database

MMichał You can update bindings via rest api after you create the database

Old Man Maker•10/19/23, 7:47 AM

Thanks for the response, I assume this is under a bindings API?

Old Man Maker•10/19/23, 7:50 AM

Actually I see worker binding api is depreciated

Old Man Maker•10/19/23, 8:04 AM

I think you're referring to the patch functions for worker script API? That's about all I could find. The problem with that is we are limited to the number of bindings as far as I know to about 5000 per worker. So this would not be a suitable solution if we have say 20k databases.
If the only option is to query a DB with REST calls, I assume there is a latency penalty as opposed to a binding call if executed from the same worker?

I've just take a look inside the code, and I was confused, It's not what I've thought. I need somet

Similar Threads

Similar Threads

Similar Threads