Yeah this is a thing, but that workaround wouldn't be good in combination with Workers for Platforms

GGunnar There is a "Limit Increase Request Form" for KV https://developers.cloudflare.co...

B

BenyOP•4/11/24, 11:18 AM

I've never tried the limit increase before but I've seen some people here mention their requests went unanswered for weeks so it puts me off a bit (and it is strange hosting it on a Google form, doesn't feel official)

Oom Can d1 sizes be increased more then 10gb?

M

Max (@rozenmd)•4/11/24, 11:42 AM

no, see conversation above: d1-database

Oom I get it. It's awesome. But how much can a 10gb store. If it's json row?

M

Max (@rozenmd)•4/11/24, 11:44 AM

millions of rows: d1-database

M

Max (@rozenmd)•4/11/24, 11:45 AM

figure out how big your rows are, divide 10GB by that size, that's how many rows you can store

Oom And if i separate database so much. Like if have blog and it's exceeding 10gb. T...

M

Max (@rozenmd)•4/11/24, 11:47 AM

the classic challenge is figuring out the right way to split the data, not always easy

Oom Is there way can I invoke a worker or http request if the data in the db changes...

M

Max (@rozenmd)•4/11/24, 11:47 AM

not without polling the db, not yet anyway

Oom And if i separate database so much. Like if have blog and it's exceeding 10gb. T...

M

Max (@rozenmd)•4/11/24, 11:54 AM

say you have a blog with 10kb of text (~1k words) per article, that's a million articles for 10GB

ZZiga Zajc I have json string stored in D1. What function should be used to return object b...

M

Max (@rozenmd)•4/11/24, 12:34 PM

this doc might be useful https://developers.cloudflare.com/d1/build-with-d1/query-json/

BBeny Yeah this is a thing, but that workaround wouldn't be good in combination with W...

H

Hello, I’m Allie!•4/11/24, 12:44 PM

Could you pass in an RPC target that makes reads only to their “namespace”?

ZZiga Zajc ```sql SELECT uuid, json_array(titles) as titles, year FROM anime; ```

M

Max (@rozenmd)•4/11/24, 12:46 PM

wouldn't you want to do something like:

json_extract(titles, $.romanji) as romanji, json_extract(titles, $.english) as english, ...

json_extract(titles, $.romanji) as romanji, json_extract(titles, $.english) as english, ...

?

M

Max (@rozenmd)•4/11/24, 12:47 PM

not sure if sqlite supports the idea of nesting objects in a response

M

Max (@rozenmd)•4/11/24, 1:14 PM

titles -> $

titles -> $

or

titles ->> $

titles ->> $

might do it

D

dakom•4/11/24, 1:29 PM

is it safe to leak the database id? i.e. to publish

wrangler.toml

wrangler.toml

which has database id bindings ?

Ddakom is it safe to leak the database id? i.e. to publish `wrangler.toml` which has da...

H

Hello, I’m Allie!•4/11/24, 1:32 PM

Yes. The entirety of

wrangler.toml

wrangler.toml

is safe to publish, as long as you aren't putting secrets in it

Ddakom is it safe to leak the database id? i.e. to publish `wrangler.toml` which has da...

A

Acе•4/11/24, 1:40 PM

The ID only works for workers in your account so it should be fine

M

mau•4/11/24, 3:55 PM

My where condition with an index on id is taking 2.0-2.2 seconds. If I get everything from the table it takes 2.3-2.8 seconds. Is it normal?

M

mau•4/11/24, 3:58 PM

M

mau•4/11/24, 3:59 PM

M

mau•4/11/24, 4:00 PM

any thoughts? thanks!

M

mau•4/11/24, 4:03 PM

M

mau•4/11/24, 4:03 PM

Oops

M

mau•4/11/24, 4:04 PM

okay, is it good? 500+ms...

M

mau•4/11/24, 4:06 PM

it ranges from 500+ms to 1.2 seconds

M

mau•4/11/24, 4:21 PM

import type { DrizzleD1Database } from 'drizzle-orm/d1';
import { drizzle } from 'drizzle-orm/d1';
import { eq } from 'drizzle-orm/expressions';
import type { Request as IttyRequest, Route } from 'itty-router';
import { Router } from 'itty-router';
import { json } from 'itty-router-extras';

import { users } from './schema';
import { sql } from 'drizzle-orm';

export interface Env {
    DB: D1Database;
}

interface Request extends IttyRequest {
    db: DrizzleD1Database;
}

interface Methods {
    get: Route;
    post: Route;
}

async function injectDB(request: Request, env: Env) {
    const db = drizzle(env.DB);
    request.db = db;
}

const router = Router<Request, Methods>({ base: '/' });

router.get("/favicon.ico",()=>{
    return json({});
})

router.get('/users', injectDB, async (req: Request, env: Env) => {
    const query = req.db.select().from(users);
    console.log(query.toSQL());
    const result = await query.all();
    return json(result);
});

router.get('/users/:id', injectDB, async (req: Request, env: Env) => {
    const result : any = await req.db
        .select().from(users)
        .where(eq(users.id, Number(req.params!['id'])))
        .get();
    return json(result);
});

router.post('/users', injectDB, async (req: Request, env: Env) => {
    const { name, email } = await req.json!();
    const res = await req.db.insert(users).values({ name, email }).returning().get();
    return json({ res });
});

router.get("/indexes",injectDB, async(req,env)=>{
    let data = await req.db.run(sql`SELECT name, type, sql FROM sqlite_schema WHERE type IN ('index');`);
    return json(data);
})

export default {
    fetch: router.handle,
};

import type { DrizzleD1Database } from 'drizzle-orm/d1';
import { drizzle } from 'drizzle-orm/d1';
import { eq } from 'drizzle-orm/expressions';
import type { Request as IttyRequest, Route } from 'itty-router';
import { Router } from 'itty-router';
import { json } from 'itty-router-extras';

import { users } from './schema';
import { sql } from 'drizzle-orm';

export interface Env {
    DB: D1Database;
}

interface Request extends IttyRequest {
    db: DrizzleD1Database;
}

interface Methods {
    get: Route;
    post: Route;
}

async function injectDB(request: Request, env: Env) {
    const db = drizzle(env.DB);
    request.db = db;
}

const router = Router<Request, Methods>({ base: '/' });

router.get("/favicon.ico",()=>{
    return json({});
})

router.get('/users', injectDB, async (req: Request, env: Env) => {
    const query = req.db.select().from(users);
    console.log(query.toSQL());
    const result = await query.all();
    return json(result);
});

router.get('/users/:id', injectDB, async (req: Request, env: Env) => {
    const result : any = await req.db
        .select().from(users)
        .where(eq(users.id, Number(req.params!['id'])))
        .get();
    return json(result);
});

router.post('/users', injectDB, async (req: Request, env: Env) => {
    const { name, email } = await req.json!();
    const res = await req.db.insert(users).values({ name, email }).returning().get();
    return json({ res });
});

router.get("/indexes",injectDB, async(req,env)=>{
    let data = await req.db.run(sql`SELECT name, type, sql FROM sqlite_schema WHERE type IN ('index');`);
    return json(data);
})

export default {
    fetch: router.handle,
};

import type { DrizzleD1Database } from 'drizzle-orm/d1';
import { drizzle } from 'drizzle-orm/d1';
import { eq } from 'drizzle-orm/expressions';
import type { Request as IttyRequest, Route } from 'itty-router';
import { Router } from 'itty-router';
import { json } from 'itty-router-extras';

import { users } from './schema';
import { sql } from 'drizzle-orm';

export interface Env {
    DB: D1Database;
}

interface Request extends IttyRequest {
    db: DrizzleD1Database;
}

interface Methods {
    get: Route;
    post: Route;
}

async function injectDB(request: Request, env: Env) {
    const db = drizzle(env.DB);
    request.db = db;
}

const router = Router<Request, Methods>({ base: '/' });

router.get("/favicon.ico",()=>{
    return json({});
})

router.get('/users', injectDB, async (req: Request, env: Env) => {
    const query = req.db.select().from(users);
    console.log(query.toSQL());
    const result = await query.all();
    return json(result);
});

router.get('/users/:id', injectDB, async (req: Request, env: Env) => {
    const result : any = await req.db
        .select().from(users)
        .where(eq(users.id, Number(req.params!['id'])))
        .get();
    return json(result);
});

router.post('/users', injectDB, async (req: Request, env: Env) => {
    const { name, email } = await req.json!();
    const res = await req.db.insert(users).values({ name, email }).returning().get();
    return json({ res });
});

router.get("/indexes",injectDB, async(req,env)=>{
    let data = await req.db.run(sql`SELECT name, type, sql FROM sqlite_schema WHERE type IN ('index');`);
    return json(data);
})

export default {
    fetch: router.handle,
};

import type { DrizzleD1Database } from 'drizzle-orm/d1';
import { drizzle } from 'drizzle-orm/d1';
import { eq } from 'drizzle-orm/expressions';
import type { Request as IttyRequest, Route } from 'itty-router';
import { Router } from 'itty-router';
import { json } from 'itty-router-extras';

import { users } from './schema';
import { sql } from 'drizzle-orm';

export interface Env {
    DB: D1Database;
}

interface Request extends IttyRequest {
    db: DrizzleD1Database;
}

interface Methods {
    get: Route;
    post: Route;
}

async function injectDB(request: Request, env: Env) {
    const db = drizzle(env.DB);
    request.db = db;
}

const router = Router<Request, Methods>({ base: '/' });

router.get("/favicon.ico",()=>{
    return json({});
})

router.get('/users', injectDB, async (req: Request, env: Env) => {
    const query = req.db.select().from(users);
    console.log(query.toSQL());
    const result = await query.all();
    return json(result);
});

router.get('/users/:id', injectDB, async (req: Request, env: Env) => {
    const result : any = await req.db
        .select().from(users)
        .where(eq(users.id, Number(req.params!['id'])))
        .get();
    return json(result);
});

router.post('/users', injectDB, async (req: Request, env: Env) => {
    const { name, email } = await req.json!();
    const res = await req.db.insert(users).values({ name, email }).returning().get();
    return json({ res });
});

router.get("/indexes",injectDB, async(req,env)=>{
    let data = await req.db.run(sql`SELECT name, type, sql FROM sqlite_schema WHERE type IN ('index');`);
    return json(data);
})

export default {
    fetch: router.handle,
};

https://github.com/drizzle-team/drizzle-orm/tree/main/examples/cloudflare-d1

GitHub

drizzle-orm/examples/cloudflare-d1 at main · drizzle-team/drizzle-orm

Headless TypeScript ORM with a head. Runs on Node, Bun and Deno. Lives on the Edge and yes, it's a JavaScript ORM too

drizzle-team/drizzle-orm

Yeah this is a thing, but that workaround wouldn't be good in combination with Workers for Platforms

Similar Threads