Hi, am new here. But there's something I need an understanding. I have a Sveltekit project hosted

Hi, am new here. But there's something I need an understanding.

I have a Sveltekit project hosted on Cloudflare Pages. And now I want to add D1 as the database on this project.

I created the database using the D1 dashboard.

I want to follow the D1 docs, but it seems mostly it centered around Wrangler and Workers sort of.

How do I get started with D1 for a Pages project? Please any help or link to any doc? Thank you.

Max (@rozenmd)•1/31/24, 7:35 AM

A fix for inflated rows_written counts is coming: https://github.com/cloudflare/workerd/pull/1594

GitHub

sqlite: don't count rows written to temporary (ephemeral) tables by...

SQLite may generate temporary tables while executing a SELECT statement. Rows written to these tables shouldn't count as they're not under control of the user.
This change is essentially
tu...

Tthedelanyo Hi, am new here. But there's something I need an understanding. I have a Svelt...

Matt Silverlock•1/31/24, 8:04 AM

Have you looked at https://developers.cloudflare.com/d1/examples/d1-and-sveltekit/ or https://developers.cloudflare.com/pages/framework-guides/deploy-a-svelte-site/

GGagan Suie why am i getting this error?? `"Error: D1_TYPE_ERROR: Type 'boolean' not support...

Patrick•1/31/24, 4:29 PM

Did you end up converting your boolean types to integers?

Running into Error: D1_TYPE_ERROR: Type 'boolean' not supported for value 'false'

It looks like the docs under queries mention that it's converted, but this is on an insert where my migration creates the table with boolean types. Was curious if I should just be typing these integer and storing 1/0 instead of messing with true/false.

edit/ seems like yes, i should be using integers. it might be helpful if the migration execution would fail when you incorrectly use boolean

MMatt Silverlock Have you looked at https://developers.cloudflare.com/d1/examples/d1-and-svelteki...

thedelanyoOP•1/31/24, 4:30 PM

Okay. Thank you Sir. Will look it up

KK How many points of presence will read replications have?

K•1/31/24, 6:51 PM

Just bumping. CF has 300 pops. D1 has some 6 locations (eu , us etc) for compliance. So what is planned for D1 in terms of PoPs?

KK Just bumping. CF has 300 pops. D1 has some 6 locations (eu , us etc) for complia...

Chaika•1/31/24, 6:55 PM

D1 runs on Durable Object (DOs), which are only in specific colos/pops and regions: https://where.durableobjects.live/

Where Durable Objects Live

Tracking where Durable Objects are created, wherever you are in the world.

Chaika•1/31/24, 6:55 PM

employees have mentioned a few times that south america support is planned d1-database

CChaika D1 runs on Durable Object (DOs), which are only in specific colos/pops and regio...

K•1/31/24, 7:05 PM

Haven't seen this site before. Thank s for pointing it out.

PPatrick Did you end up converting your boolean types to integers? Running into Error: D...

Gagan Suie•1/31/24, 7:54 PM

Yes. Convert to int and store in DB as 1/0

DDavid Renshaw I have a fresh database and an initial migration: ``` -- I don't expect there to...

Max (@rozenmd)•1/31/24, 8:11 PM

it's a bug in the API, yeah

Max (@rozenmd)•2/1/24, 1:40 PM

we should really stop calling them experimental

Vignesh•2/1/24, 6:14 PM

Can I store 40gb db on D1?

VVignesh Can I store 40gb db on D1?

zegevlier•2/1/24, 6:41 PM

Not right now, no: https://developers.cloudflare.com/d1/platform/limits/

zegevlier•2/1/24, 6:42 PM

That limit is marked as beta and subject to increase, but if it'll increase >40gb I do not know

zegevlier•2/1/24, 6:42 PM

If you really want to use D1 you might be able to store it as several smaller databases though

bun•2/2/24, 12:03 AM

i inserted like 2000 records. tried quering a random record by id. it takes ~130-150 ms. is this expected even after multiple requests?

bun•2/2/24, 12:05 AM

import { Hono } from "hono";

const app = new Hono<{
  Bindings: {
    DB: D1Database;
  };
}>();

app.get("/", async (c) => {
  const result = c.env.DB.prepare(`
    select * from users where id = 420;
  `);

  const t = performance.now();

  await result.first();

  return c.text(`Query took ${performance.now() - t}ms`);
});

export default app;

import { Hono } from "hono";

const app = new Hono<{
  Bindings: {
    DB: D1Database;
  };
}>();

app.get("/", async (c) => {
  const result = c.env.DB.prepare(`
    select * from users where id = 420;
  `);

  const t = performance.now();

  await result.first();

  return c.text(`Query took ${performance.now() - t}ms`);
});

export default app;

bun•2/2/24, 12:39 AM

i get 0.150-0.300 on duration

bun•2/2/24, 12:39 AM

is it 150-300 ms ?

bun•2/2/24, 12:42 AM

ah so it takes actual 0.1-0.3 miliseconds

bun•2/2/24, 12:42 AM

then why is networking such an issue? is it because the worker it not located close to the database?

Chaika•2/2/24, 12:43 AM

yea duration is in milliseconds. You can see where your worker is in via `npx wrangler d1 info <db-name>, and look for running_in_region

bun•2/2/24, 12:44 AM

you mean worker or db ?

bun•2/2/24, 12:45 AM

ok latency is reduced to 10ms after i enabled smart placement

Chaika•2/2/24, 12:45 AM

That would show the location of the db. Worker is likely way closer to you. You could look at https://<worker-host-name>/cdn-cgi/tracehttps://<worker-host-name>/cdn-cgi/trace i.e https://cloudflare.com/cdn-cgi/tracehttps://cloudflare.com/cdn-cgi/trace and look at colo= for the airport code of where the worker is running

Chaika•2/2/24, 12:45 AM

if you have smart placement on then you'd look at the cf-placement response header

Chaika•2/2/24, 12:46 AM

also make sure your db version shown in d1 info is beta, not alpha

bun•2/2/24, 12:48 AM

yeah with smart placement latency is low. however, it increases the request latency from 10 ms to 100-200 ms now. honestly i think there should be easier way to solve the problem im trying to deal with right now.

i have like less than 1 mb JSON data that i want to somehow have ready at all point of worker requests.

i tried getting it from r2 and caching but it didnt work for some reason.

do you think it would be better to just include the data in the bundle instead of using database for this?

Chaika•2/2/24, 12:49 AM

where are you/where are your users geographically? Are you in a region like South America/South Africa?

bun•2/2/24, 12:49 AM

no im in eastern europe

Chaika•2/2/24, 12:50 AM

oh so D1 should be close unless it was created with a location hint far away or for some reason created itself in a region far away

bun•2/2/24, 12:50 AM

i created it manually with eastern europe setting

Bbun yeah with smart placement latency is low. however, it increases the request late...

Chaika•2/2/24, 12:50 AM

The question about bundling it would come down to if it changed and if so how frequently

bun•2/2/24, 12:51 AM

the data wouldnt change

bun•2/2/24, 12:51 AM

at all

Chaika•2/2/24, 12:52 AM

then I think bundling would be a good idea. If you are on Workers Paid you get up to 10 mb, but if you go over 1 mb you get put in slower storage/slightly slower then first request, still super fast. If your worker is below 1 mb then your worker is ready to go on every machine

bun•2/2/24, 12:53 AM

1mb compressed ?

Chaika•2/2/24, 12:53 AM

yea gzip

bun•2/2/24, 12:54 AM

im on workers paid yes

bun•2/2/24, 12:54 AM

so everything below 1 mb does not affect performance ?

bun•2/2/24, 12:54 AM

then it affects only on initial request?

Chaika•2/2/24, 12:54 AM

D1 at the moment is a single location with read replicas eventually
R2 single location + cache (although you could cache any of these)
DOs are single locations
KV is made for read heavy stuff but two locations until cached
Worker Scripts less then 1 mb are everywhere
https://developers.cloudflare.com/workers/platform/storage-options/

Bbun so everything below 1 mb does not affect performance ?

Chaika•2/2/24, 12:55 AM

well if you were doing a lot in the global scope you could still have a cold starts

Chaika•2/2/24, 12:55 AM

should prob move to #workers-discussions if you wanted to ask more about that idea

bun•2/2/24, 12:55 AM

yeah sure

import { Hono } from "hono"; const app = new Hono<{ Bindings: { DB: D1Database; }; }>(); app.get("/", async (c) => { const result = c.env.DB.prepare(` select * from users where id = 420; `); const t = performance.now(); await result.first(); return c.text(`Query took ${performance.now() - t}ms`); }); export default app;

Hi, am new here. But there's something I need an understanding. I have a Sveltekit project hosted

Similar Threads