Check #general-help latest.

Ddqwqwdldowqqw Check #general-help latest.

H

Hard@Work•6/25/24, 4:46 PM

?pings

F

Flare•6/25/24, 4:46 PM

Please do not ping community members for non-moderation reasons. Doing so will not solve your issue faster and will make people less likely to want to help you.

H

Hard@Work•6/25/24, 4:46 PM

Also, not sure what this has to do with D1

S

SteffTek•6/25/24, 5:14 PM

i've got this error multiple times while migrating my database. someone knows why this keeps showing up? i always killed the last migration but this time i have follow migrations and it's not that easy

S

SteffTek•6/25/24, 5:31 PM

i removed so many comments after finding a github issue, this is dumb lol

EEisenbergEffect Looking at limits to D1, I see that a single DB is limted to 10GB and that an ac...

S

Sam•6/25/24, 5:52 PM

The 10gb per database not, but I think the account limit can be increased by contacting support

Ppeshakoo I wonder how many users I can fit into 10GB without sharding

S

SteffTek•6/25/24, 5:59 PM

SSoftbear I'm using TablePlus

V

vrballer•6/25/24, 10:23 PM

Thanks!

P

puerh•6/26/24, 12:24 PM

Is there any way to restrict people from just using the UI to add a record to a d1 database directly (or even KV) - but still giving them worker write access? Feels like a really annoying permissions gap if not

I just want a db that we can only add to through known sources rather than anyone with enough permissions in cloudflare

Original message was deleted

P

puerh•6/26/24, 6:51 PM

I think that's what I'm trying to work out

Ideally the only way to deploy something that touches the DB will be through Github and atleast then it's reviewed.
But atm it feels a little impossible to store anything that's even remotely sensitive as it's a complete wild west. But I don't think Cloudflare offers the sort of permissions model I'm after.

I'm a Cloudflare admin, and I don't really want the permission to add records to the database directly through the UI

U

Unsmart•6/26/24, 6:58 PM

I mean realistically no platform offers that kind of permission model. But for all platforms you basically need to do the permission side of stuff in github actions where the github action can deploy the worker and not the user

U

Unsmart•6/26/24, 6:59 PM

I dont think cloudflare offers a read only view of workers resources though unless I am just missing it so they wont be able to use UI to view any D1/KV/etc stuff

R

rampatra•6/26/24, 8:16 PM

Can someone help me with this issue - https://github.com/cloudflare/cloudflare-docs/issues/15343 ?

GitHub

Need instructions for existing workers · Issue #15343 · cloudflare/...

Existing documentation URL(s) Doc link - https://developers.cloudflare.com/d1/get-started/ This page lists nicely the steps when creating a worker from scratch but what if someone already has a wor...

R

rampatra•6/26/24, 8:18 PM

I am trying to follow the instructions and set up this DB environment variable in my nextjs app but I am stuck at the very first step.

R

rampatra•6/26/24, 8:25 PM

I think the doc is outdated. Let me try something.

S

surgery18•6/27/24, 12:18 AM

Hey, my project I am working on (uses pages, a few workers, R2, durable objects, and queue) currently uses Mongodb. I was thinking of converting my DB and my entire code base to use D1 instead. Before I do that, I want to know a couple of things.

1) Can D1 be used for a commerical project? Or is it more for hobby/personal projects? I am thinking for amount of requests hitting the db and what it can handle.
2) I think this is the big one, would I notice a big difference in speed from mongo to D1. If I convert to D1 then the whole architecture would be on Cloudflare and in my mind that means it would be quicker.

Thanks

D

Disciple of Caoximeihao•6/28/24, 9:55 AM


      SELECT DISTINCT *
      FROM variantValues vv
      JOIN options o ON o.optionId = vv.optionId
      JOIN optionValues ov ON ov.valueId = vv.valueId
      WHERE vv.variantId IN '(7, 8, 9, 10)'


      SELECT DISTINCT *
      FROM variantValues vv
      JOIN options o ON o.optionId = vv.optionId
      JOIN optionValues ov ON ov.valueId = vv.valueId
      WHERE vv.variantId IN '(7, 8, 9, 10)'


      SELECT DISTINCT *
      FROM variantValues vv
      JOIN options o ON o.optionId = vv.optionId
      JOIN optionValues ov ON ov.valueId = vv.valueId
      WHERE vv.variantId IN '(7, 8, 9, 10)'


      SELECT DISTINCT *
      FROM variantValues vv
      JOIN options o ON o.optionId = vv.optionId
      JOIN optionValues ov ON ov.valueId = vv.valueId
      WHERE vv.variantId IN '(7, 8, 9, 10)'

hello, how to not working?

D

Disciple of Caoximeihao•6/28/24, 9:55 AM

help

M

Muudka•6/28/24, 11:00 AM

Hello,

We have a SaaS application that utilizes a shared codebase. When onboarding a new user, we create a dedicated database for them, apply migration schemas, load default data, and insert the user's details into a metadata database. This metadata is then linked to the user.

We have a centralized logging system that directs users to the appropriate database by retrieving their connection details from the metadata database and passing them to Prisma. We are currently using PostgreSQL with Prisma.

We would like to know if this behavior can be replicated using workers. Specifically, do the worker and D1 need to be bound simultaneously? At present, we have over 1,000 users, and this system is functioning well for us. The application is not very complex, so migrating from PostgreSQL to SQLite would not be an issue.

Additionally, can the worker accept connections to a D1 database that it is not bound to?

O

oof2win2•6/28/24, 2:28 PM

so i have multiple apps that share the same database, such as apps/connector, apps/dashboard, but the issue is how do i make them share the same database locally as well? on remote wrangler deployments it works because the database is identified by its id but locally it doesnt work and say the schema isnt shared

AAlexandru Rosianu Seeing similar errors: > Error: D1 storage operation exceeded timeout which cau...

A

Alec | Kriebel LLC.•6/28/24, 3:28 PM

Just got this

D1_ERROR: Internal error while starting up D1 storage caused object to be reset.

D1_ERROR: Internal error while starting up D1 storage caused object to be reset.

D1_ERROR: Internal error while starting up D1 storage caused object to be reset.

D1_ERROR: Internal error while starting up D1 storage caused object to be reset. error again this morning on a DB with 118.78kb of data.

J

JustinNoel•6/28/24, 7:55 PM

I'm not associated with this in any way (not even a customer). However, if you're new to SQLite of wonder if it's up to your needs, this might help.
https://highperformancesqlite.com/

Home - High Performance SQLite

A comprehensive video course by database educator Aaron Francis. Learn everything you need to confidently use SQLite in production.

FFriday Candour Just buy a vps.

S

surgery18•6/28/24, 8:03 PM

Huh? VPS? That isn't what I was asking.

Ppeshakoo you would def notice a big difference in speed. Most of my queries take less tha...

S

surgery18•6/28/24, 8:33 PM

Ok, that is what I was thinking. Gonna dread doing the conversion since it is ALOT of files to modify, But in the end it should be well worth it.

B

Baqir•6/29/24, 5:42 AM

Hi folks, need some help for creating D1 binding using Drizzle. I have this code.

I want to get the DB dynamically based on the client who user ID. Is there a solution?

I have a solution which is to create a mapping like

const mapping = { [tenantId1] : env.DB_TENANT_1

const mapping = { [tenantId1] : env.DB_TENANT_1

const mapping = { [tenantId1] : env.DB_TENANT_1

const mapping = { [tenantId1] : env.DB_TENANT_1 and so on, but is there something better?

Thanks

BBaqir Hi folks, need some help for creating D1 binding using Drizzle. I have this code...

B

Baqir•6/29/24, 5:52 AM

Think I figured it out. Needed to add this line in my env.d.ts

[key: string]: D1Database;

Thanks to Claude

J

JustinNoel•6/29/24, 2:19 PM

Update: Solved by adding

--remote

--remote

. See discession below.

I'm not sure I understand how to do a migration.

Scenario:

I've never used a migration before. I've modified a few tables in my local db, done my development code to deal with these changes.
Now, I've pushed my code and it's active in the preview environment of CF pages.

Migration Attempt:

I created a migration file using

wrangler d1 migrations create preview-say-my-name move-authentication-to-workos

wrangler d1 migrations create preview-say-my-name move-authentication-to-workos

wrangler d1 migrations create preview-say-my-name move-authentication-to-workos

wrangler d1 migrations create preview-say-my-name move-authentication-to-workos.

I edited the migration file with:

ALTER TABLE customers ADD COLUMN auth_service_user_id TEXT;
DROP TABLE IF EXISTS `magiclinks`;
DROP TABLE IF EXISTS `sessions`;
DROP TABLE IF EXISTS `login_passcodes`;

ALTER TABLE customers ADD COLUMN auth_service_user_id TEXT;
DROP TABLE IF EXISTS `magiclinks`;
DROP TABLE IF EXISTS `sessions`;
DROP TABLE IF EXISTS `login_passcodes`;

ALTER TABLE customers ADD COLUMN auth_service_user_id TEXT;
DROP TABLE IF EXISTS `magiclinks`;
DROP TABLE IF EXISTS `sessions`;
DROP TABLE IF EXISTS `login_passcodes`;

ALTER TABLE customers ADD COLUMN auth_service_user_id TEXT;
DROP TABLE IF EXISTS `magiclinks`;
DROP TABLE IF EXISTS `sessions`;
DROP TABLE IF EXISTS `login_passcodes`;

When I run

wrangler d1 migrations apply preview-say-my-name

wrangler d1 migrations apply preview-say-my-name

wrangler d1 migrations apply preview-say-my-name

wrangler d1 migrations apply preview-say-my-name, i get:

Migration 0001_move-authentication-to-workos.sql failed with the following errors:
✘ [ERROR] no such table: customers

Questions:

It seems that my original database and all its data is not used in the migration. So, it seems my migrations file is required to contain all the original schema and inserts for the exiting data.

Is that correct? This sure makes life painful and sort of makes migrations useless.

Do I have to continue doing this for every migration or once I've done the first, will the system be smart enough to carry data forward?

Feedback:

There's just not enough explanation of this in the docs.

JJustinNoel **Update:** Solved by adding `--remote`. See discession below. I'm not sure I ...

H

Hello, I’m Allie!•6/29/24, 2:32 PM

Just to confirm, is this local mode?

HHello, I’m Allie!Just to confirm, is this local mode?

J

JustinNoel•6/29/24, 2:42 PM

No. preview/staging is what i'm attempting right now.

Original message was deleted

J

JustinNoel•6/29/24, 2:47 PM

That did it! i was assuming it would have read that info from my

wrangler.toml

wrangler.toml

because it had to add it for

wrangler d1 migrations create preview-say-my-name move-authentication-to-workos

wrangler d1 migrations create preview-say-my-name move-authentication-to-workos

wrangler d1 migrations create preview-say-my-name move-authentication-to-workos

wrangler d1 migrations create preview-say-my-name move-authentication-to-workos.

Thanks so much!

Aakira.eth const env = getMiniflareBindings() anyone know why this isn't returning my db bi...

M

Matt Silverlock•6/29/24, 3:41 PM

What version are you on?

https://developers.cloudflare.com/d1/build-with-d1/local-development/#miniflare

https://developers.cloudflare.com/d1/build-with-d1/local-development/#miniflare

https://developers.cloudflare.com/d1/build-with-d1/local-development/#miniflare

https://developers.cloudflare.com/d1/build-with-d1/local-development/#miniflare

M

Matt Silverlock•6/29/24, 3:42 PM

(Can’t make clickable as Discord interprets the anchor as a channel link)

M

Matt Silverlock•6/29/24, 3:42 PM

https://developers.cloudflare.com/d1/build-with-d1/local-development/ - scroll down

Cloudflare Docs

Local development · Cloudflare D1 docs

D1 has fully-featured support for local development, running the same version of D1 as Cloudflare runs globally. Local development uses Wrangler, the …

FFriday Candour Maybe you are solving a problem wrongly.

T

Tilon•6/30/24, 12:47 PM

Maybe you are in the wrong forum...

Ssurgery18 Ok, that is what I was thinking. Gonna dread doing the conversion since it is AL...

J

Jason Hostetter•6/30/24, 4:04 PM

Before you undertake a big conversion, I’d recommend looking closely at D1’s limitations in the docs, to make sure the data you’re migrating will fall within those limits. For example, there is a row size limit of 1MB, which is pretty big, but if you are doing things like saving unbounded data from user input, or like base64 encoded images you could hit that.

JJason Hostetter Before you undertake a big conversion, I’d recommend looking closely at D1’s lim...

S

surgery18•6/30/24, 6:49 PM

Yeah, I should be ok with that limit. Any image stuff just gets saved into a R2 bucket and a key gets saved in the DB. So I should be ok with the limit.

M

malone•6/30/24, 6:50 PM

what are people doing to unit test with D1 databases?

I ideally want to just pass a mock d1 database to my Hono app i import, and not deal with cloudflare wrangler/miniflare as much as possible. i want to do this so i can use Bun's tests which are really fast.

is this possible right now? if I use miniflare@3 it hangs when i request a DB, and if I use miniflare@2 it looks like i need to run the whole worker and it wants me to use a vitest or jest integration

M

malone•6/30/24, 6:52 PM

i want to do some large scale changes to my side project and didn't write any tests, so i'm trying to get some tests in before making big changes

M

malone•6/30/24, 9:04 PM

I ended up just making my own D1Database conforming thing that wraps bun:sqlite, good enough for my use

O

Oli•6/30/24, 10:02 PM

Hi! Just joined here, is the "raw" endpoint for the D1 rest api broken?

Always getting:
" "errors": [
{
"code": 7400,
"message": "The request is malformed: failed to decode id"
}
"

And i saw something on it not working on github, but the issues were not super recent. It dosent work when using wrangler neither..

D

Disciple of Caoximeihao•7/1/24, 9:29 AM

how to use cloudflare worker localhost and d1 remote?

Similar Threads

Similar Threads

Similar Threads