`console.log(JSON.parse(user?.settings?.hello))` `message: "undefined" is not valid JSON`

console.log(JSON.parse(user?.settings?.hello))

console.log(JSON.parse(user?.settings?.hello))

console.log(JSON.parse(user?.settings?.hello))

console.log(JSON.parse(user?.settings?.hello))

message: "undefined" is not valid JSON

message: "undefined" is not valid JSON

message: "undefined" is not valid JSON

message: "undefined" is not valid JSON

manstfuOP•6/17/23, 1:07 PM

and with console.log(JSON.parse(user?.settings))console.log(JSON.parse(user?.settings))

Matt Silverlock•6/17/23, 1:20 PM

https://developers.cloudflare.com/d1/learning/querying-json/#extracting-values

specifically the “Extracting values” section - lots of examples.

Query JSON · Cloudflare D1 docs

D1 has built-in support for querying and parsing JSON data stored within a database. This enables you to:

Matt Silverlock•6/17/23, 1:23 PM

If you’re learning, using the dashboard’s console to test out functions or wrangler d1 execute your-db —command="SELECT json_extract(…) FROM yourtable"wrangler d1 execute your-db —command="SELECT json_extract(…) FROM yourtable" is a good way to experiment.

Jjbonett Hi, I’m starting a new project which would like to release within around 3 month...

Matt Silverlock•6/18/23, 11:51 AM

https://blog.cloudflare.com/d1-turning-it-up-to-11/

The Cloudflare Blog

D1: We turned it up to 11

We've been heads down iterating on D1, and we've just shipped a major new version that's substantially faster, more reliable, and introduces Time Travel: the ability to restore a D1 database to any point in time.

SStan I was unable to connect with D1 using SvelteKit after a day of struggling due to...

Matt Silverlock•6/18/23, 11:55 AM

You don’t need to use that library. Use the Cloudflare adapter - follow these steps: https://developers.cloudflare.com/pages/framework-guides/deploy-a-svelte-site/#sveltekit-cloudflare-configuration

SStan I was unable to connect with D1 using SvelteKit after a day of struggling due to...

Matt Silverlock•6/18/23, 12:41 PM

A working example: https://github.com/elithrar/svelte-demo-d1

I just ran through the SvelteKit tutorial. Let it be known that I am not a big fan of SvelteKit and find the TypeScript support very janky.
```ts
// file: routes/api/users/+server.ts
import type { RequestHandler } from "@sveltejs/kit";

** @type {import('@sveltejs/kit').RequestHandler} */
export async function GET({ request, platform }) {
let result = await platform.env.DB.prepare(
"SELECT * FROM users LIMIT 5"
).run();
return new Response(JSON.stringify(result));
}
```

Jjbonett Thanks, but is there a timeline for increasing the current limits?

Matt Silverlock•6/18/23, 3:05 PM

We don’t publish exact timelines (see my pinned messages for a longer explanation). It’s soon, but you’re just going to be frustrated if I give you a date and we don’t hit it because there’s a bug or edge case that breaks things.

MetalGear•6/18/23, 6:37 PM

Hey guys,
I’m trying to decide between planet scale and d1 for my saas. The only thing holding me back from d1 is having to worry about database storage limit. Like planet scale Im under the impression you just create a database and never have to worry about a single thing and it grows in size as you need it to

Unsmart•6/18/23, 6:41 PM

D1 is in alpha and shouldnt really be used for production critical applications.

UUnsmart D1 is in alpha and shouldnt really be used for production critical applications.

MetalGear•6/18/23, 6:58 PM

I know I’m referencing to when it’s released

Unsmart•6/18/23, 6:59 PM

When D1 is released I assume it will have much much much higher limits to storage than it does now. But it is going to be in alpha for some time so you shouldnt plan on using it if you are already working on a service you want to use for critical production workloads

UUnsmart When D1 is released I assume it will have much much much higher limits to storag...

MetalGear•6/18/23, 7:00 PM

Thanks I get that and using planet scale for now but watching d1 carefully as I’d like to migrate to using only cf services in future so that’s why I’m asking

MetalGear•6/18/23, 7:00 PM

My question I guess is does cloudflare plan to auto scale for users like planet scale does

MetalGear•6/18/23, 7:01 PM

Or is that something they have settled that we have to do ourselves with sharding? How would one even handle having multiple databases due to reaching size limits

JSON•6/19/23, 3:22 AM

I just saw that new information was updated in d1 price.
The price of reading is reasonable
It may not be completed yet, but I have a few questions.

Does the UPDATE query go into Write units?
Does "Workers Paid" mean First 50 million is free? Or are you saying that up to 50 million is charged $1 per million?

Unsmart•6/19/23, 3:25 AM

Updates are writes.

For workers paid plan the first 50 million write units are free. The first 25 billion read units are free. (But pricing isn’t final and subject to change)

UUnsmart Updates are writes. For workers paid plan the first 50 million write units are...

JSON•6/19/23, 3:28 AM

Thank you for your answer!
Then I think it's much cheaper than I expected!
I will change my postgres db to sqlite sometime this week to move quickly when d1 is released!

JSON•6/19/23, 3:31 AM

I have one last question

When using the Workers Paid model
Do I get 5 million every day in the free section in addition to the first 25 billion?

Unsmart•6/19/23, 3:38 AM

No those tiers are separate

UUnsmart No those tiers are separate

JSON•6/19/23, 3:48 AM

Thank you. I had no conscience lol

Ggeelen Our underlying infrastructure is quite different to PlanetScale, which makes cer...

Steved•6/19/23, 8:59 AM

Do we know yet how multiple databases will work yet? At the moment the limitations of the binding make having multiple DBs awkward. I'm hoping to use a separate DB per SaaS tenant. I can't currently see how that would fit the current bindings. Other systems, e.g. Azure SQL have a logical 'Server' that contains individual databases. That would work (assuming you don't call it 'Server').

SSteved Do we know yet how multiple databases will work yet? At the moment the limitatio...

Matt Silverlock•6/19/23, 12:47 PM

We have some ideas here for the “thousands to tens of thousands of tenants” - that will isolate each DB you create. Can’t share more yet and won’t be “next month”.

Jjoostschuur Can I access a binding to use D1 from a local Node script (i.e. not a worker whe...

Matt Silverlock•6/20/23, 10:51 AM

Your current options:

Shell out to wranglerwrangler and have it run commands/import files for you
Put your own HTTP API in front of D1
Use wrangler devwrangler dev in remote mode against your live DB

Jjoostschuur To be honest, I am kind of tempted to just bundle all my data right into the wor...

Matt Silverlock•6/20/23, 11:15 AM

Why not KV? If it’s read heavy. You can bundle into your script but will eventually hit script size limits.

vassbence•6/20/23, 11:22 AM

Hi!

I've spent quite a few hours looking up this specific use-case but could not find much help online so I'd like to ask:

How can I work with D1 in the context of integration/e2e tests?
Let's say I have a JSON REST API written in a Worker.

As for the Worker itself I can use wranglers unstable_dev()unstable_dev() API to set up everything for testing.

My code currently looks like this:

describe("backend json rest api", () => {
  let worker;

  before(async () => {
    worker = await unstable_dev("src/index.ts", {
      experimental: { disableExperimentalWarning: true },
    });
  });

  after(async () => {
    await worker.stop();
  });

  // ... actual tests here
});

describe("backend json rest api", () => {
  let worker;

  before(async () => {
    worker = await unstable_dev("src/index.ts", {
      experimental: { disableExperimentalWarning: true },
    });
  });

  after(async () => {
    await worker.stop();
  });

  // ... actual tests here
});

At the very least it would be nice to have a fresh database ready at the start of the test. So like create a new SQLite file and run all the migrations. Currently the worker in the code above simply accesses my local D1 file.

How could I accomplish this in a way that would later fit into CI/CD etc?

Jjoostschuur Let me see if I get this right: If I wanted to trigger a sync process between KV...

vassbence•6/20/23, 11:26 AM

There are Unbound Workers which have no execution time limit.

Vvassbence Hi! I've spent quite a few hours looking up this specific use-case but could n...

vassbence•6/20/23, 11:32 AM

As for my usecase I guess I could run shell scripts before testing to clean up and migrate the database but it would be nice if the tests somehow had their own instance/database file and they would not interfere with the local development file.

Any insight?

vassbence•6/20/23, 11:37 AM

persistTo to a temporary file and execute migrations in the before function?

vassbence•6/20/23, 11:39 AM

AFAIK wrangler d1 migrations appy just runs the migration files one after another with execute()

vassbence•6/20/23, 11:39 AM

and so I can do the same without using child_process or similar node apis to keep everything progamatical in the test

vassbence•6/20/23, 11:44 AM

oh yeah my bad you can not access the actual D1 APIs from the test, so I either have to create an endpoint inside the Worker to run the migrations or fall back to child_process.exec to run wrangler d1 migrations apply

vassbence•6/20/23, 11:47 AM

Guess I just wanted to have one less dependency.. So you run better-sqlite3 on the db file which gets generated in a known location (since we set it in persistTopersistTo) then read the migrations files and execute them via better-sliqte3?

vassbence•6/20/23, 11:56 AM

Wrangler usees Miniflare as per the codebase but then I guess miniflare 3 is using better-sqlite3?

Max (@rozenmd)•6/20/23, 12:03 PM

IIRC it might even be in the codebase twice

`console.log(JSON.parse(user?.settings?.hello))` `message: "undefined" is not valid JSON`

Similar Threads

Similar Threads

Similar Threads