Can you check your database now? It should be fixed.

Llambrospetrou Can you check your database now? It should be fixed.

T

TrulyUnlucky•12/21/24, 9:00 AM

It works indeed! Thank you

Bbutter hey guys i've been trying to setup a project that uses nextjs, hono, drizzle and...

T

Trojan•12/22/24, 1:17 PM

this happens because the API for the sqlite d1 file in miniflare is slightly different from the managed postgres api in live. Please share your solution because mine is really dumb

import { defineConfig, type Config } from "drizzle-kit";
import { parse as parseJsonc } from "comment-json";
import { existsSync, readFileSync } from "fs";
import { join } from "path";

const wranglerConfig = parseJsonc(
  readFileSync(join(__dirname, "wrangler.jsonc"), "utf-8"),
) as unknown as WranglerConfig;

const d1Config = wranglerConfig.d1_databases[0];

const env = Object.fromEntries(
  ((filePath) =>
    existsSync(filePath)
      ? readFileSync(filePath, "utf-8")
          .split("\n")
          .filter((line) => line.trim() && !line.startsWith("#"))
          .map((line) =>
            line
              .split(/=(.+)/)
              .filter(Boolean)
              .map((part) => part.trim()),
          )
          .filter((parts) => parts.length === 2)
          .map(([key, value]) => [key, value?.replace(/^["']|["']$/g, "")])
      : [])(join(process.cwd(), ".dev.vars")),
) as Record<string, string>;

/*
 * NOTE: Workaround to make drizzle studio work with D1.
 * https://kevinkipp.com/blog/going-full-stack-on-astro-with-cloudflare-d1-and-drizzle/
 * Github discussion: https://github.com/drizzle-team/drizzle-orm/discussions/1545#discussioncomment-8115423
 */
export default process.env["NODE_ENV"] === "production"
  ? defineConfig({
      dialect: "sqlite",
      driver: "d1-http",
      out: "drizzle",
      schema: "src/db/schema.ts",
      dbCredentials: {
        accountId: env["CF_ACCOUNT_ID"]!,
        token: env["CF_D1_TOKEN"]!,
        databaseId: d1Config!.database_id!,
      },
    } satisfies Config)
  : defineConfig({
      dialect: "sqlite",
      out: "drizzle",
      schema: "src/db/schema.ts",
      dbCredentials: {
        url: env["DB_LOCAL_PATH"]!,
      },
    } satisfies Config);

import { defineConfig, type Config } from "drizzle-kit";
import { parse as parseJsonc } from "comment-json";
import { existsSync, readFileSync } from "fs";
import { join } from "path";

const wranglerConfig = parseJsonc(
  readFileSync(join(__dirname, "wrangler.jsonc"), "utf-8"),
) as unknown as WranglerConfig;

const d1Config = wranglerConfig.d1_databases[0];

const env = Object.fromEntries(
  ((filePath) =>
    existsSync(filePath)
      ? readFileSync(filePath, "utf-8")
          .split("\n")
          .filter((line) => line.trim() && !line.startsWith("#"))
          .map((line) =>
            line
              .split(/=(.+)/)
              .filter(Boolean)
              .map((part) => part.trim()),
          )
          .filter((parts) => parts.length === 2)
          .map(([key, value]) => [key, value?.replace(/^["']|["']$/g, "")])
      : [])(join(process.cwd(), ".dev.vars")),
) as Record<string, string>;

/*
 * NOTE: Workaround to make drizzle studio work with D1.
 * https://kevinkipp.com/blog/going-full-stack-on-astro-with-cloudflare-d1-and-drizzle/
 * Github discussion: https://github.com/drizzle-team/drizzle-orm/discussions/1545#discussioncomment-8115423
 */
export default process.env["NODE_ENV"] === "production"
  ? defineConfig({
      dialect: "sqlite",
      driver: "d1-http",
      out: "drizzle",
      schema: "src/db/schema.ts",
      dbCredentials: {
        accountId: env["CF_ACCOUNT_ID"]!,
        token: env["CF_D1_TOKEN"]!,
        databaseId: d1Config!.database_id!,
      },
    } satisfies Config)
  : defineConfig({
      dialect: "sqlite",
      out: "drizzle",
      schema: "src/db/schema.ts",
      dbCredentials: {
        url: env["DB_LOCAL_PATH"]!,
      },
    } satisfies Config);

import { defineConfig, type Config } from "drizzle-kit";
import { parse as parseJsonc } from "comment-json";
import { existsSync, readFileSync } from "fs";
import { join } from "path";

const wranglerConfig = parseJsonc(
  readFileSync(join(__dirname, "wrangler.jsonc"), "utf-8"),
) as unknown as WranglerConfig;

const d1Config = wranglerConfig.d1_databases[0];

const env = Object.fromEntries(
  ((filePath) =>
    existsSync(filePath)
      ? readFileSync(filePath, "utf-8")
          .split("\n")
          .filter((line) => line.trim() && !line.startsWith("#"))
          .map((line) =>
            line
              .split(/=(.+)/)
              .filter(Boolean)
              .map((part) => part.trim()),
          )
          .filter((parts) => parts.length === 2)
          .map(([key, value]) => [key, value?.replace(/^["']|["']$/g, "")])
      : [])(join(process.cwd(), ".dev.vars")),
) as Record<string, string>;

/*
 * NOTE: Workaround to make drizzle studio work with D1.
 * https://kevinkipp.com/blog/going-full-stack-on-astro-with-cloudflare-d1-and-drizzle/
 * Github discussion: https://github.com/drizzle-team/drizzle-orm/discussions/1545#discussioncomment-8115423
 */
export default process.env["NODE_ENV"] === "production"
  ? defineConfig({
      dialect: "sqlite",
      driver: "d1-http",
      out: "drizzle",
      schema: "src/db/schema.ts",
      dbCredentials: {
        accountId: env["CF_ACCOUNT_ID"]!,
        token: env["CF_D1_TOKEN"]!,
        databaseId: d1Config!.database_id!,
      },
    } satisfies Config)
  : defineConfig({
      dialect: "sqlite",
      out: "drizzle",
      schema: "src/db/schema.ts",
      dbCredentials: {
        url: env["DB_LOCAL_PATH"]!,
      },
    } satisfies Config);

import { defineConfig, type Config } from "drizzle-kit";
import { parse as parseJsonc } from "comment-json";
import { existsSync, readFileSync } from "fs";
import { join } from "path";

const wranglerConfig = parseJsonc(
  readFileSync(join(__dirname, "wrangler.jsonc"), "utf-8"),
) as unknown as WranglerConfig;

const d1Config = wranglerConfig.d1_databases[0];

const env = Object.fromEntries(
  ((filePath) =>
    existsSync(filePath)
      ? readFileSync(filePath, "utf-8")
          .split("\n")
          .filter((line) => line.trim() && !line.startsWith("#"))
          .map((line) =>
            line
              .split(/=(.+)/)
              .filter(Boolean)
              .map((part) => part.trim()),
          )
          .filter((parts) => parts.length === 2)
          .map(([key, value]) => [key, value?.replace(/^["']|["']$/g, "")])
      : [])(join(process.cwd(), ".dev.vars")),
) as Record<string, string>;

/*
 * NOTE: Workaround to make drizzle studio work with D1.
 * https://kevinkipp.com/blog/going-full-stack-on-astro-with-cloudflare-d1-and-drizzle/
 * Github discussion: https://github.com/drizzle-team/drizzle-orm/discussions/1545#discussioncomment-8115423
 */
export default process.env["NODE_ENV"] === "production"
  ? defineConfig({
      dialect: "sqlite",
      driver: "d1-http",
      out: "drizzle",
      schema: "src/db/schema.ts",
      dbCredentials: {
        accountId: env["CF_ACCOUNT_ID"]!,
        token: env["CF_D1_TOKEN"]!,
        databaseId: d1Config!.database_id!,
      },
    } satisfies Config)
  : defineConfig({
      dialect: "sqlite",
      out: "drizzle",
      schema: "src/db/schema.ts",
      dbCredentials: {
        url: env["DB_LOCAL_PATH"]!,
      },
    } satisfies Config);

M

maguayo•12/24/24, 7:03 AM

If D1 is distributed (read only) why so much diference from just a SELECT from the EU and the US?

Mmaguayo If D1 is distributed (read only) why so much diference from just a SELECT from t...

H

Hello, I’m Allie!•12/24/24, 7:05 AM

It’s not, D1 is single-location for now

HHello, I’m Allie!It’s not, D1 is single-location for now

M

maguayo•12/24/24, 7:07 AM

It's there a timeline? I am migrating everything because the documentation says it's distributed

M

maguayo•12/24/24, 7:09 AM

I thought you could have many instances in each region or something like that

M

maguayo•12/24/24, 7:10 AM

There is a whole section in D1 documentation about read replicas. Is this not true??

FFriday Candour "RETURNING *" not working on D1 how to get around that?

M

maguayo•12/24/24, 7:57 AM

I mean.. they market as D1 is distributed and read replicas.. I expected you know, they have read replicas.

Mmaguayo There is a whole section in D1 documentation about read replicas. Is this not tr...

H

Hello, I’m Allie!•12/24/24, 8:07 AM

It’s a planned feature, but it doesn’t exist yet

FFriday Candour but it's same query right?

M

maguayo•12/24/24, 8:14 AM

Exactly the same query from different locations.

HHello, I’m Allie!It’s a planned feature, but it doesn’t exist yet

M

maguayo•12/24/24, 8:15 AM

Can we know if it's planned for Q1 or more into the future?

FFriday Candour omg cloudflare

M

maguayo•12/24/24, 10:17 AM

Yeah.. Time to refactor everything since I counted with read replicas since their documentation mentions them...

TTrojan this happens because the API for the sqlite d1 file in miniflare is slightly dif...

T

theo•12/24/24, 6:12 PM

I might have a tool that helps a bit with managing the env/config

T

theo•12/24/24, 6:14 PM

loads config like dotenv but also has validations, and a nice wrangler integration - https://dmno.dev/

Ttheo I might have a tool that helps a bit with managing the env/config

T

Trojan•12/24/24, 8:38 PM

dang thanks! i’ll check it out

TTrojan dang thanks! i’ll check it out

T

theo•12/24/24, 8:44 PM

the cloudflare integration is brand new, so happy to help and work through any issues

T

Trojan•12/24/24, 8:52 PM

“Being able to see all of these values and which one is currently active will save you tons of headaches”

huge. im tired of “zero config” “common sense” “best practice” “no code” etc

FFriday Candour "RETURNING *" not working on D1 how to get around that?

O

o7•12/26/24, 11:39 PM

it works for me

A

Amodeus R.•12/27/24, 12:59 AM

I was trying out the d1 get started guide and the first command to create a d1 project doesn't work. I tried using npm and it throw a 404 Error. I tried using npx also but a similar error happened, although a little bit different as you can see on the terminal. I tried installing create-cloudfare and it also didn't work. What do I need to do to make it work?

AAmodeus R.I was trying out the d1 get started guide and the first command to create a d1 p...

J

James•12/27/24, 1:28 AM

It looks like you typo’d cloudflare to cloudfare

A

Amodeus R.•12/27/24, 2:36 AM

Oh, what a rookie mistake haha thanks for pointing it out

K

kamama•12/27/24, 5:16 AM

If I got multiple databases in local, how can I get the exact SQLite path for specific database ?

I

iqorex•12/27/24, 8:27 AM

Hey i have db per user case, and now i need to check it with cron if a user have some event scheduled to do some processing and send emails. Is there any smart way of querying all databases at once?

J

James•12/27/24, 2:08 PM

sadly not really. If we had dynamic bindings this'd be easier, which were a "before GA" promise as per https://canary.discord.com/channels/595317990191398933/992060581832032316/1164575886520090684, but still nothing to report there.

JJames sadly not really. If we had dynamic bindings this'd be easier, which were a "bef...

I

iqorex•12/27/24, 3:12 PM

thanks

JJames sadly not really. If we had dynamic bindings this'd be easier, which were a "bef...

Z

Zack•12/27/24, 7:09 PM

Read only replicas are coming before the end of the year too!

:COPIUM:

ZZack Read only replicas are coming before the end of the year too! 😅 :COPIUM:

M

maguayo•12/27/24, 9:46 PM

where did you see that anouncement?

Mmaguayo where did you see that anouncement?

Z

Zack•12/27/24, 9:46 PM

In one of the blog posts

Iiqorex Hey i have db per user case, and now i need to check it with cron if a user have...

1

1984 Ford Laser•12/28/24, 1:21 AM

Durable Objects would be the best way forward here

A

ajgeiss0702•12/29/24, 3:02 AM

the math aint mathing

Aajgeiss0702 the math aint mathing

H

Hello, I’m Allie!•12/29/24, 6:29 AM

That might be because the system that powers account-level analytics may be a bit behind the actual values

HHello, I’m Allie!That might be because the system that powers account-level analytics may be a bi...

A

ajgeiss0702•12/29/24, 6:29 AM

if thats the case, then that would be like a year behind

Aajgeiss0702 if thats the case, then that would be like a year behind

H

Hello, I’m Allie!•12/29/24, 6:30 AM

Weird

A

ajgeiss0702•12/29/24, 6:31 AM

that 3gb db has been well past that size for a loooong time

A

ajgeiss0702•12/29/24, 6:32 AM

not the end of the world, but a bit odd

A

Amodeus R.•12/29/24, 12:24 PM

Is it possible to use a backend framework like fastify in a wrangler/d1 project? And what about postgres to make queries?

K

kamama•12/29/24, 2:18 PM

I’m encountering D1 slow response, like 500ms+, but my table only have 10 rows, the database is under APAC region. Is that expected?

K

kamama•12/29/24, 2:18 PM

Request without D1 fetch, around 30ms. With D1 fetch around 600ms

W

Walshy•12/29/24, 2:19 PM

Where is your worker invoked?

W

Walshy•12/29/24, 2:19 PM

And are you using smart placement?

WWalshy Where is your worker invoked?

K

kamama•12/29/24, 2:22 PM

Also under APAC

K

kamama•12/29/24, 2:23 PM

default placement

Original message was deleted

I

Igal•12/29/24, 10:33 PM

Lighter Prisma is in the works.
The Kysely gap you described is solvable today-ish with plugins, and possibly in the future with some new APIs (but without turning the library into yet another ORM.)

Can you check your database now? It should be fixed.

Similar Threads