Hi, I wanted to ask about the reliability of D1 in case I ever need to add a new column to a large t

Hi, I wanted to ask about the reliability of D1 in case I ever need to add a new column to a large table.

Let's assume I have a "users" table containing 1 million rows. One time I wanted to add a new column to the table. Is the process as fast as I imagined?

Although I have never experienced something like that before, I will definitely experience it someday. And it's probably not just me.

Rriskiidrus Hi, I wanted to ask about the reliability of D1 in case I ever need to add a new...

itsmatteomanf•8/31/23, 8:22 AM

Adding a column, which is empty at the start, is very fast on any SQL database.

itsmatteomanf•8/31/23, 8:22 AM

You'll then need to do up to a million writes to fill it.

riskiidrusOP•8/31/23, 8:29 AM

Thank you for your answer. I was very relieved to hear that.

But when can we use D1 for production? I'm really looking forward to it

Elliot Hesp•8/31/23, 9:30 AM

Does anyone know how you're supposed to run Drizzle Kit migrations on D1? https://orm.drizzle.team/kit-docs/quick

Elliot Hesp•8/31/23, 9:31 AM

No issues making the migration, but I'm not sure how it's going to connect to the DB outside of the wrangler / fetch handler

Elliot Hesp•8/31/23, 9:40 AM

Got it: https://sat0shi.dev/posts/drizzle-migration/

Type-Safely database migration on Cloudflare D1 with Drizzle ORM

Drizzle Kit allows you to easily migrate your database schema on Cloudflare D1.

itsmatteomanf•8/31/23, 10:39 AM

I'm not sure there is a way, but can you get the keys from a JSON object within D1? I know I can get the values, but not sure about the keys.

Iitsmatteomanf I'm not sure there is a way, but can you get the keys from a JSON object within ...

Isaac McFadyen•8/31/23, 10:40 AM

https://stackoverflow.com/questions/70759212/select-distinct-keys-from-a-json-column-in-sqlite not sure if D1 exposes them specifically but SQLite's JSON1 allows for it.

Stack Overflow

select distinct keys from a json column in SQLite

a TEXT column of a SQLite database contains json values like these one:
[{"key1":"116"},{"key2":"260"},{"key3":"123"},{"key4":&...

itsmatteomanf•8/31/23, 10:40 AM

Oh, that looks promising.

Matt Silverlock•8/31/23, 11:25 AM

json_eachjson_each - https://developers.cloudflare.com/d1/learning/querying-json/#supported-functions

Query JSON · Cloudflare D1 docs

D1 has built-in support for querying and parsing JSON data stored within a database. This enables you to:

MMatt Silverlock `json_each` - https://developers.cloudflare.com/d1/learning/querying-json/#suppo...

itsmatteomanf•8/31/23, 11:43 AM

Yeah, that one above worked

I didn’t think it returned the key, too. It works, it’s not the fastest but it’s 10s of keys on tens of thousands of rows

itsmatteomanf•8/31/23, 11:44 AM

@rozenmd adding to the request for indexes, maybe show views, too

Epailes•8/31/23, 12:10 PM

Are there any examples of a popular CMS setup with D1 yet?

EEpailes Are there any examples of a popular CMS setup with D1 yet?

Cyb3r-Jak3•8/31/23, 1:24 PM

I mean someone made a CMS on workers https://discord.com/channels/595317990191398933/783765338692386886/1133082793962909846

CCyb3r-Jak3 I mean someone made a CMS on workers https://discord.com/channels/59531799019139...

Epailes•8/31/23, 3:10 PM

Ooh I'd missed that post thanks for sharing!
Was mainly looking to see if there was a full CMS, not headless, but interesting read none the less!

Unsmart•8/31/23, 5:53 PM

It wont be removed just higher 100s of GBs. Can probably do a search and find the messages about it specifically

Unsmart•8/31/23, 5:57 PM

I mean D1 isnt a global db. Eventually it will have read regions sure but its single region writer so

Unsmart•8/31/23, 6:09 PM

Afaik eventually they are working on a thing that will allow dynamic creation of D1 similar to durable objects where you can do env.D1.get("table-id").query("SELECT something from 'my-table'"). But thats probably very long out goal

Unsmart•8/31/23, 6:10 PM

Would have to find that message where they said that

kian•8/31/23, 6:39 PM

None that Cloudflare provide

Unsmart•8/31/23, 6:46 PM

I mean even through all of those status pages I havent had any issues with anything I host on CF pages and I only had 1 request error to a service I use that uses cloudflare so

ZZiga Zajc Thanks, basically based on #cloudflare-status there is downtime almost every day...

DaniFoldi•8/31/23, 7:42 PM

that's true for most providers - the only difference is whether they sweep "small" outages under the rug, or still create an incident

giuseppelt•8/31/23, 11:43 PM

Is there some issue with the Pages binding? It stopped to work all the sudden

giuseppelt•8/31/23, 11:43 PM

The env key is missing, instead I see a strange __D1_BETA__DB__D1_BETA__DB

giuseppelt•8/31/23, 11:44 PM

Are you moving to beta, and something is mssing?

Unsmart•8/31/23, 11:44 PM

afaik D1 bindings have always been like that because of the alpha

giuseppelt•8/31/23, 11:44 PM

giuseppelt•8/31/23, 11:45 PM

if you named the binding DB, you'll get a DB key on the env

giuseppelt•8/31/23, 11:45 PM

it always worked, I found out it stopped, could be a couple of hours, maybe more

giuseppelt•8/31/23, 11:45 PM

but yesterday was working

Cyb3r-Jak3•8/31/23, 11:46 PM

I think there is an issue with wrangler 3.5.0 so you should stick to 3.4.X for now

Unsmart•8/31/23, 11:47 PM

If that doesnt fix it search the discord __D1_BETA__DB __D1_BETA__DB and you will see lots of convos about it might be able to find something to fix it there

Hi, I wanted to ask about the reliability of D1 in case I ever need to add a new column to a large t

Similar Threads

Similar Threads

Similar Threads