- Cloudflare Developers

M

manstfuOP•6/17/23, 12:34 PM

this is with json_array

R

raise;•6/17/23, 12:35 PM

man what you are trying is called

parse/extract json

parse/extract json

parse/extract json

parse/extract json, so u are using the wrong functions

R

raise;•6/17/23, 12:37 PM

Most of these json functions are designed to help you manipulate/store the data.

Mmanstfu Click to see attachment

R

raise;•6/17/23, 12:37 PM

try to use

json_extract

json_extract

json_extract

json_extract

M

manstfuOP•6/17/23, 12:38 PM

R

raise;•6/17/23, 12:39 PM

json_extract(${usersTable.settings}, '$')

json_extract(${usersTable.settings}, '$')

json_extract(${usersTable.settings}, '$')

json_extract(${usersTable.settings}, '$')

M

manstfuOP•6/17/23, 12:40 PM

null

M

manstfuOP•6/17/23, 12:40 PM

and with '$' only

settings
: 
"{\"hello\":[\"world\",\"there\"]}"

settings
: 
"{\"hello\":[\"world\",\"there\"]}"

settings
: 
"{\"hello\":[\"world\",\"there\"]}"

settings
: 
"{\"hello\":[\"world\",\"there\"]}"

Mmanstfu and with '$' only `settings : "{\"hello\":[\"world\",\"there\"]}"`

R

raise;•6/17/23, 12:42 PM

examples

SELECT json_extract('{"hello":["world","there"]}', '$.hello');

SELECT json_extract('{"hello":["world","there"]}', '$.hello');

SELECT json_extract('{"hello":["world","there"]}', '$.hello');

SELECT json_extract('{"hello":["world","there"]}', '$.hello');
->

'["world","there"]'

'["world","there"]'

'["world","there"]'

'["world","there"]'

SELECT json_extract('{"hello":["world","there"]}', '$');

SELECT json_extract('{"hello":["world","there"]}', '$');

SELECT json_extract('{"hello":["world","there"]}', '$');

SELECT json_extract('{"hello":["world","there"]}', '$');
->

'{"hello":["world","there"]}'

'{"hello":["world","there"]}'

'{"hello":["world","there"]}'

'{"hello":["world","there"]}'

R

raise;•6/17/23, 12:43 PM

So its confirmed, you need to parse(jsondecode) that data in your side.

Rraise;**So its confirmed, you need to parse(jsondecode) that data in your side.**

M

manstfuOP•6/17/23, 1:06 PM

console.log(JSON.parse(user?.settings?.hello))

console.log(JSON.parse(user?.settings?.hello))

console.log(JSON.parse(user?.settings?.hello))

console.log(JSON.parse(user?.settings?.hello))

message: "undefined" is not valid JSON

message: "undefined" is not valid JSON

message: "undefined" is not valid JSON

message: "undefined" is not valid JSON

M

manstfuOP•6/17/23, 1:07 PM

and with

console.log(JSON.parse(user?.settings))

console.log(JSON.parse(user?.settings))

console.log(JSON.parse(user?.settings))

console.log(JSON.parse(user?.settings))

M

Matt Silverlock•6/17/23, 1:20 PM

https://developers.cloudflare.com/d1/learning/querying-json/#extracting-values

specifically the “Extracting values” section - lots of examples.

Query JSON · Cloudflare D1 docs

D1 has built-in support for querying and parsing JSON data stored within a database. This enables you to:

M

Matt Silverlock•6/17/23, 1:23 PM

If you’re learning, using the dashboard’s console to test out functions or

wrangler d1 execute your-db —command="SELECT json_extract(…) FROM yourtable"

wrangler d1 execute your-db —command="SELECT json_extract(…) FROM yourtable"

wrangler d1 execute your-db —command="SELECT json_extract(…) FROM yourtable"

wrangler d1 execute your-db —command="SELECT json_extract(…) FROM yourtable" is a good way to experiment.

Jjbonett Hi, I’m starting a new project which would like to release within around 3 month...

M

Matt Silverlock•6/18/23, 11:51 AM

https://blog.cloudflare.com/d1-turning-it-up-to-11/

The Cloudflare Blog

D1: We turned it up to 11

We've been heads down iterating on D1, and we've just shipped a major new version that's substantially faster, more reliable, and introduces Time Travel: the ability to restore a D1 database to any point in time.

SStan I was unable to connect with D1 using SvelteKit after a day of struggling due to...

M

Matt Silverlock•6/18/23, 11:55 AM

You don’t need to use that library. Use the Cloudflare adapter - follow these steps: https://developers.cloudflare.com/pages/framework-guides/deploy-a-svelte-site/#sveltekit-cloudflare-configuration

SStan I was unable to connect with D1 using SvelteKit after a day of struggling due to...

M

Matt Silverlock•6/18/23, 12:41 PM

A working example: https://github.com/elithrar/svelte-demo-d1

I just ran through the SvelteKit tutorial. Let it be known that I am not a big fan of SvelteKit and find the TypeScript support very janky.
```ts
// file: routes/api/users/+server.ts
import type { RequestHandler } from "@sveltejs/kit";

** @type {import('@sveltejs/kit').RequestHandler} */
export async function GET({ request, platform }) {
let result = await platform.env.DB.prepare(
"SELECT * FROM users LIMIT 5"
).run();
return new Response(JSON.stringify(result));
}
```

Jjbonett Thanks, but is there a timeline for increasing the current limits?

M

Matt Silverlock•6/18/23, 3:05 PM

We don’t publish exact timelines (see my pinned messages for a longer explanation). It’s soon, but you’re just going to be frustrated if I give you a date and we don’t hit it because there’s a bug or edge case that breaks things.

M

MetalGear•6/18/23, 6:37 PM

Hey guys,
I’m trying to decide between planet scale and d1 for my saas. The only thing holding me back from d1 is having to worry about database storage limit. Like planet scale Im under the impression you just create a database and never have to worry about a single thing and it grows in size as you need it to

U

Unsmart•6/18/23, 6:41 PM

D1 is in alpha and shouldnt really be used for production critical applications.

UUnsmart D1 is in alpha and shouldnt really be used for production critical applications.

M

MetalGear•6/18/23, 6:58 PM

I know I’m referencing to when it’s released

U

Unsmart•6/18/23, 6:59 PM

When D1 is released I assume it will have much much much higher limits to storage than it does now. But it is going to be in alpha for some time so you shouldnt plan on using it if you are already working on a service you want to use for critical production workloads

UUnsmart When D1 is released I assume it will have much much much higher limits to storag...

M

MetalGear•6/18/23, 7:00 PM

Thanks I get that and using planet scale for now but watching d1 carefully as I’d like to migrate to using only cf services in future so that’s why I’m asking

M

MetalGear•6/18/23, 7:00 PM

My question I guess is does cloudflare plan to auto scale for users like planet scale does

M

MetalGear•6/18/23, 7:01 PM

Or is that something they have settled that we have to do ourselves with sharding? How would one even handle having multiple databases due to reaching size limits

J

JSON•6/19/23, 3:22 AM

I just saw that new information was updated in d1 price.
The price of reading is reasonable
It may not be completed yet, but I have a few questions.

Does the UPDATE query go into Write units?
Does "Workers Paid" mean First 50 million is free? Or are you saying that up to 50 million is charged $1 per million?

U

Unsmart•6/19/23, 3:25 AM

Updates are writes.

For workers paid plan the first 50 million write units are free. The first 25 billion read units are free. (But pricing isn’t final and subject to change)

UUnsmart Updates are writes. For workers paid plan the first 50 million write units are...

J

JSON•6/19/23, 3:28 AM

Thank you for your answer!
Then I think it's much cheaper than I expected!
I will change my postgres db to sqlite sometime this week to move quickly when d1 is released!

J

JSON•6/19/23, 3:31 AM

I have one last question

When using the Workers Paid model
Do I get 5 million every day in the free section in addition to the first 25 billion?

U

Unsmart•6/19/23, 3:38 AM

No those tiers are separate

UUnsmart No those tiers are separate

J

JSON•6/19/23, 3:48 AM

Thank you. I had no conscience lol

Ggeelen Our underlying infrastructure is quite different to PlanetScale, which makes cer...

S

Steved•6/19/23, 8:59 AM

Do we know yet how multiple databases will work yet? At the moment the limitations of the binding make having multiple DBs awkward. I'm hoping to use a separate DB per SaaS tenant. I can't currently see how that would fit the current bindings. Other systems, e.g. Azure SQL have a logical 'Server' that contains individual databases. That would work (assuming you don't call it 'Server').

SSteved Do we know yet how multiple databases will work yet? At the moment the limitatio...

M

Matt Silverlock•6/19/23, 12:47 PM

We have some ideas here for the “thousands to tens of thousands of tenants” - that will isolate each DB you create. Can’t share more yet and won’t be “next month”.

Jjoostschuur Can I access a binding to use D1 from a local Node script (i.e. not a worker whe...

M

Matt Silverlock•6/20/23, 10:51 AM

Your current options:

Shell out to
```
wrangler
```
```
wrangler
```
and have it run commands/import files for you
Put your own HTTP API in front of D1
Use
```
wrangler dev
```
```
wrangler dev
```
in remote mode against your live DB

Jjoostschuur To be honest, I am kind of tempted to just bundle all my data right into the wor...

M

Matt Silverlock•6/20/23, 11:15 AM

Why not KV? If it’s read heavy. You can bundle into your script but will eventually hit script size limits.

V

vassbence•6/20/23, 11:22 AM

Hi!

I've spent quite a few hours looking up this specific use-case but could not find much help online so I'd like to ask:

How can I work with D1 in the context of integration/e2e tests?
Let's say I have a JSON REST API written in a Worker.

As for the Worker itself I can use wranglers

unstable_dev()

unstable_dev()

API to set up everything for testing.

My code currently looks like this:

describe("backend json rest api", () => {
  let worker;

  before(async () => {
    worker = await unstable_dev("src/index.ts", {
      experimental: { disableExperimentalWarning: true },
    });
  });

  after(async () => {
    await worker.stop();
  });

  // ... actual tests here
});

describe("backend json rest api", () => {
  let worker;

  before(async () => {
    worker = await unstable_dev("src/index.ts", {
      experimental: { disableExperimentalWarning: true },
    });
  });

  after(async () => {
    await worker.stop();
  });

  // ... actual tests here
});

describe("backend json rest api", () => {
  let worker;

  before(async () => {
    worker = await unstable_dev("src/index.ts", {
      experimental: { disableExperimentalWarning: true },
    });
  });

  after(async () => {
    await worker.stop();
  });

  // ... actual tests here
});

describe("backend json rest api", () => {
  let worker;

  before(async () => {
    worker = await unstable_dev("src/index.ts", {
      experimental: { disableExperimentalWarning: true },
    });
  });

  after(async () => {
    await worker.stop();
  });

  // ... actual tests here
});

At the very least it would be nice to have a fresh database ready at the start of the test. So like create a new SQLite file and run all the migrations. Currently the worker in the code above simply accesses my local D1 file.

How could I accomplish this in a way that would later fit into CI/CD etc?

Jjoostschuur Let me see if I get this right: If I wanted to trigger a sync process between KV...

V

vassbence•6/20/23, 11:26 AM

There are Unbound Workers which have no execution time limit.

Similar Threads