~5,000 or so https://developers.cloudflare.com/d1/platform/limits/ Using Durable Object's SQlite mak

~5,000 or so https://developers.cloudflare.com/d1/platform/limits/
Using Durable Object's SQlite makes sense if you're going to have a good amount of them/create dynamically: https://blog.cloudflare.com/sqlite-in-durable-objects/
API has rate limits (1.2k / 5 mins per user) shared across dashboard and all endpoints. Durable Objects can be created/sent requests to dynamically

Jjose luis The type `D1PreparedStatement` has a `statement` property, but `TS` doesn't kno...

lambrospetrou•1/7/25, 3:57 PM

preparedStatement.statement

preparedStatement.statement

is not meant to be used by client Worker code (i.e. you). You have access to the statement since you are the one providing it to the

prepare()

prepare()

method, so use that instead.

Accessing private (as in non-documented) fields is a great recipe for future breakages when we change those fields. We do need to hide them properly (or whatever that will be in the JS world by obfuscating...) on our side though.

After you

prepare()

prepare()

and optionally

bind()

bind()

, only call these methods: https://developers.cloudflare.com/d1/worker-api/prepared-statements/

CChaika ~5,000 or so https://developers.cloudflare.com/d1/platform/limits/ Using Durable...

w3bcode•1/7/25, 4:11 PM

I assume durable objects would also have limits regarding storage size. Does this suit well, if we want to have multi tentant data ?

When using Durable Objects, it's important to remember that they are intended to scale out, not up. A single object is inherently limited in throughput since it runs on a single thread of a single machine. To handle more traffic, you create more objects. This is easiest when different objects can handle different logical units of state (like different documents, different users, or different "shards" of a database), where each unit of state has low enough traffic to be handled by a single object.

Ww3bcode I assume durable objects would also have limits regarding storage size. Does thi...

ChaikaOP•1/7/25, 4:18 PM

D1's not really any different, it itself is just built on top of Durable Objects. Although currently DO SQlite while in beta has a storage limit of 1 GB per DB and D1 has 10 per GB, I would expect them to match eventually

ChaikaOP•1/7/25, 4:19 PM

errr maybe some of this is confusion on how Durable Objects work? You code your Durable Object class and create a "Durable Object"/"Durable Object Namespace", and then you can create many instances of the Durable Object via the binding, all with their own storage limit, based on the same code

w3bcode•1/7/25, 4:20 PM

this looks interesting. I will try it out. Thanks

ChaikaOP•1/7/25, 4:21 PM

D1's supposed to eventually have some sort of a dynamic binding api so you don't have to use the API/update worker/all that jazz, but for now Durable Object SQlite fill the gap

w3bcode•1/7/25, 4:22 PM

Ohh, I think D1 would be better choice, where we want to have backup of data, I dont know yet, how it will be supported with DO though.

Ww3bcode Ohh, I think D1 would be better choice, where we want to have backup of data, I ...

ChaikaOP•1/7/25, 4:23 PM

DO Sqlite doesn't have exporting but it does have the same time travel stuff as D1 does

ChaikaOP•1/7/25, 4:24 PM

https://developers.cloudflare.com/durable-objects/api/sql-storage/#point-in-time-recovery

w3bcode•1/7/25, 4:24 PM

durable-objects

Just found out about this in other channel.

ChaikaOP•1/7/25, 4:25 PM

it's just manually looping overall the tables/fetching all the data https://github.com/outerbase/starbasedb/blob/main/src/export/dump.ts
should work, might incur a decent amount of reads but cheap

Llambrospetrou `preparedStatement.statement` is not meant to be used by client Worker code (i.e...

jose luis•1/7/25, 5:17 PM

Thanks for the answer. It's a shame though, because to me it's a useful piece of read-only information in the context of a prepared statement.

cmrpyro•1/8/25, 4:30 AM

hey folks. using the

wrangler d1

wrangler d1

command, is there any way to change the output mode to be

insert

insert

?

i'm trying to grab a few rows from prod and bring them to my local, its giving me JSON regardless of the

--json

--json

flag value

morning_eagle•1/8/25, 6:33 AM

Can I use cloudflare D1 in an express.js app hosted outside of Cloudflare? In a VPS?

Mmorning_eagle Can I use cloudflare D1 in an express.js app hosted outside of Cloudflare? In a ...

Rúben Fernandes•1/8/25, 6:36 AM

https://developers.cloudflare.com/api/resources/d1/

Cloudflare API | D1

Interact with Cloudflare's products and services via the Cloudflare API

junaid•1/8/25, 7:43 AM

hi anyone can help me to migrate mysql to d1 We are currently attempting to migrate a 20GB MySQL database to Cloudflare D1. However, we’ve encountered challenges with file size limitations and memory constraints when using the wrangler CLI tool. Specifically, we received the following error while trying to execute the SQL file locally:

✘ [ERROR] Could not read file: /path/to/large-file.sql
Cannot create a string longer than 0x1fffffe8 characters

RRúben Fernandes https://developers.cloudflare.com/api/resources/d1/

Max (@rozenmd)•1/8/25, 8:55 AM

This approach would be subject to Cloudflare API's rate limit (1200 requests over 5 minutes)

Mmorning_eagle Can I use cloudflare D1 in an express.js app hosted outside of Cloudflare? In a ...

Max (@rozenmd)•1/8/25, 8:56 AM

You'd want a pass through Worker like https://github.com/elithrar/http-api-d1-example to talk to from Express for best performance

GitHub

GitHub - elithrar/http-api-d1-example: An example HTTP API for Clou...

An example HTTP API for Cloudflare's D1 database: https://developers.cloudflare.com/d1/

elithrar/http-api-d1-example

oscar•1/8/25, 10:26 AM

Hello! we're seeing some "put: We encountered an internal error. Please try again. (10001)" in our logs in the last few minutes. Notifying this because it's something we see more or less on a weekly basis.

Ooscar Hello! we're seeing some "put: We encountered an internal error. Please try agai...

Max (@rozenmd)•1/8/25, 10:41 AM

You're seeing that error thrown when running a D1 Client API function in your Worker?

oscar•1/8/25, 11:33 AM

Yes, this is production remote though, the error was caught and I received it at 11:12AM Barcelona time

Ooscar Yes, this is production remote though, the error was caught and I received it at...

Max (@rozenmd)•1/8/25, 11:35 AM

and you're not calling any other service in that Worker?

kaede•1/8/25, 2:17 PM

Can someone explain this please

Walshy•1/8/25, 2:17 PM

#r2

MMax (@rozenmd)and you're not calling any other service in that Worker?

oscar•1/8/25, 2:18 PM

honestly haven't had the time to dig deeper on that specific call but it's most probably an alarm trigger on a DO in a Worker that also interfaces with R2, KV and other Workers. Each specific DO alarm trigger may or may not interface with each of these services depending on the characteristics of the long running job it's running.

WWalshy #r2

kaede•1/8/25, 2:26 PM

Mb bro

Ooscar honestly haven't had the time to dig deeper on that specific call but it's most ...

Max (@rozenmd)•1/8/25, 3:29 PM

Worth digging deeper on your side, that's not an error message from D1.

Ooscar Hello! we're seeing some "put: We encountered an internal error. Please try agai...

ChaikaOP•1/8/25, 3:42 PM

I've gotten that exact same error from R2 before, you mention using R2 so probably that, just need to retry

Greenrider•1/8/25, 6:33 PM

Has anyone run into an issue with 504s back from D1 when using Wrangler to do load a .sql migration file remotely? It worked the first time, but now when I want to update the DB, I'm able to upload the .sql to remote and then I immediately get a 504 gateway error before anything in the .sql runs on remote

Billy•1/8/25, 9:38 PM

Is anyone aware of an existing tool that will take a D1 export and save the file directly to R2? I know I can do all this programmatically but I was hoping there was a simpler way or a pre-existing tool for it already. Thanks

Mitya•1/9/25, 2:05 PM

Just got this, in local development with

--remote

--remote

. Should I be concerned? Never happened before; no code changes happened.

binding central of type d1 failed to generate. Please try again later or contact
  support. [code: 10021]

binding central of type d1 failed to generate. Please try again later or contact
  support. [code: 10021]

MMitya Just got this, in local development with `--remote`. Should I be concerned? Neve...

Max (@rozenmd)•1/9/25, 3:31 PM

Nah, that error can only occur during deploys (

wrangler dev --remote

wrangler dev --remote

is a special type of deployment) - usually fixes itself when you retry

CChaika I've gotten that exact same error from R2 before, you mention using R2 so probab...

oscar•1/9/25, 4:36 PM

Thanks!

MMax (@rozenmd)Worth digging deeper on your side, that's not an error message from D1.

oscar•1/9/25, 4:38 PM

True, that may be R2. We do get some D1 errors periodically, sent you some examples on DM. Might be just a case of implementing retries?

Ooscar True, that may be R2. We do get some D1 errors periodically, sent you some examp...

ChaikaOP•1/9/25, 4:38 PM

yea sane retries are a good idea: https://github.com/cloudflare/cloudflare-docs/issues/18485

esselungo•1/9/25, 8:55 PM

what would be the best setup for a grid of points being written every minute? i used to just write one row per point but d1 is just too expensive so i want to reduce the rows written

esselungo•1/9/25, 8:55 PM

is d1 even the best for that

Bailiwic•1/9/25, 9:56 PM

My build keeps looking for DATABASE_URL environment variable, but I'm using settings/binding to bind my D1 instance. I can create the variable, but don't know what to put in it since the binding doesn't have a url.

BBailiwic My build keeps looking for DATABASE_URL environment variable, but I'm using sett...

lambrospetrou•1/10/25, 9:48 AM

Are you using a framework? What is asking for that env?

Bailiwic•1/10/25, 11:46 AM

Next v14, Prisma v6. During build, error: Environment variable not found: DATABASE_URL. In settings | bindings I have D1 database, so not using wrangler to create a worker. I understand that there is no url for this binding.

BBailiwic Next v14, Prisma v6. During build, error: Environment variable not found: DATABA...

lambrospetrou•1/10/25, 1:17 PM

This error is probably coming from Prisma then. I am not familiar with Prisma, unfortunately, so hopefully someone else can chime in. In pure Worker projects nothing asks you for a database URL, since as you said D1 doesn't have a database URL.

besimking•1/10/25, 1:19 PM

Is there any possiblity for cloudflare to serve convex as a baas in the near future? Since it is open source

besimking•1/10/25, 1:22 PM

I kind a need a realtime db, that's why I asked this question

mihaaai•1/10/25, 2:00 PM

Does

maximum sql statement length

maximum sql statement length

100,000 bytes (100 KB)

100,000 bytes (100 KB)

also includes binding values? Since

Maximum string, BLOB or table row size

Maximum string, BLOB or table row size

2MB

2MB

, are values ignored from the previous constraint?

Bailiwic•1/10/25, 2:01 PM

For anyone interested, Prisma requires DATABASE_URL environment variable, even in production and using D1 binding. The value of the variable doesn't seem to make a difference.

BBailiwic For anyone interested, Prisma requires DATABASE_URL environment variable, even i...

harshil1712•1/10/25, 2:34 PM

Hey, are you using Prisma's D1 Adapter? I have used it with Remix, and got no errors on build. If you want to take a look, here's the link to the repo: https://github.com/harshil1712/remix-d1-auth-template

GitHub

GitHub - harshil1712/remix-d1-auth-template: A Remix template that ...

A Remix template that uses Cloudflare D1 for storing user data - harshil1712/remix-d1-auth-template

JoeDoe•1/12/25, 3:41 PM

Is there d1 performance issues?

JoeDoe•1/12/25, 3:41 PM

queries are taking very long atm

Viacheslav•1/12/25, 7:07 PM

hello, guys. Can anyone give me advice what wrong in my code https://github.com/Alex1998100/CloudflareD1

why this code get me 12, 000 seconds to load 1,000 records to DB.

GitHub

GitHub - Alex1998100/CloudflareD1

Contribute to Alex1998100/CloudflareD1 development by creating an account on GitHub.

Viacheslav•1/12/25, 7:10 PM

1000 rows loading 12,000 seconds

Screenshot_from_2025-01-12_18.24.21_1.png

~5,000 or so https://developers.cloudflare.com/d1/platform/limits/ Using Durable Object's SQlite mak

Similar Threads