True, that may be R2. We do get some D1 errors periodically, sent you some examples on DM. Might be

True, that may be R2. We do get some D1 errors periodically, sent you some examples on DM. Might be just a case of implementing retries?

Ooscar True, that may be R2. We do get some D1 errors periodically, sent you some examp...

Chaika•1/9/25, 4:38 PM

yea sane retries are a good idea: https://github.com/cloudflare/cloudflare-docs/issues/18485

esselungo•1/9/25, 8:55 PM

what would be the best setup for a grid of points being written every minute? i used to just write one row per point but d1 is just too expensive so i want to reduce the rows written

esselungo•1/9/25, 8:55 PM

is d1 even the best for that

Bailiwic•1/9/25, 9:56 PM

My build keeps looking for DATABASE_URL environment variable, but I'm using settings/binding to bind my D1 instance. I can create the variable, but don't know what to put in it since the binding doesn't have a url.

BBailiwic My build keeps looking for DATABASE_URL environment variable, but I'm using sett...

lambrospetrou•1/10/25, 9:48 AM

Are you using a framework? What is asking for that env?

Bailiwic•1/10/25, 11:46 AM

Next v14, Prisma v6. During build, error: Environment variable not found: DATABASE_URL. In settings | bindings I have D1 database, so not using wrangler to create a worker. I understand that there is no url for this binding.

BBailiwic Next v14, Prisma v6. During build, error: Environment variable not found: DATABA...

lambrospetrou•1/10/25, 1:17 PM

This error is probably coming from Prisma then. I am not familiar with Prisma, unfortunately, so hopefully someone else can chime in. In pure Worker projects nothing asks you for a database URL, since as you said D1 doesn't have a database URL.

besimking•1/10/25, 1:19 PM

Is there any possiblity for cloudflare to serve convex as a baas in the near future? Since it is open source

besimking•1/10/25, 1:22 PM

I kind a need a realtime db, that's why I asked this question

mihaaai•1/10/25, 2:00 PM

Does maximum sql statement lengthmaximum sql statement length of 100,000 bytes (100 KB)100,000 bytes (100 KB) also includes binding values? Since Maximum string, BLOB or table row sizeMaximum string, BLOB or table row size is 2MB2MB, are values ignored from the previous constraint?

Bailiwic•1/10/25, 2:01 PM

For anyone interested, Prisma requires DATABASE_URL environment variable, even in production and using D1 binding. The value of the variable doesn't seem to make a difference.

BBailiwic For anyone interested, Prisma requires DATABASE_URL environment variable, even i...

harshil1712•1/10/25, 2:34 PM

Hey, are you using Prisma's D1 Adapter? I have used it with Remix, and got no errors on build. If you want to take a look, here's the link to the repo: https://github.com/harshil1712/remix-d1-auth-template

GitHub

GitHub - harshil1712/remix-d1-auth-template: A Remix template that ...

A Remix template that uses Cloudflare D1 for storing user data - harshil1712/remix-d1-auth-template

JoeDoe•1/12/25, 3:41 PM

Is there d1 performance issues?

JoeDoe•1/12/25, 3:41 PM

queries are taking very long atm

Viacheslav•1/12/25, 7:07 PM

hello, guys. Can anyone give me advice what wrong in my code https://github.com/Alex1998100/CloudflareD1

why this code get me 12, 000 seconds to load 1,000 records to DB.

GitHub

GitHub - Alex1998100/CloudflareD1

Contribute to Alex1998100/CloudflareD1 development by creating an account on GitHub.

Viacheslav•1/12/25, 7:10 PM

1000 rows loading 12,000 seconds

Screenshot_from_2025-01-12_18.24.21_1.png

majestic•1/13/25, 9:03 AM

Hello,
npx wrangler d1 execute --remoe
does this command works on cloudflace pages development ?

Mmajestic Hello, npx wrangler d1 execute --remoe does this command works on cloudflace p...

Isaac McFadyen•1/13/25, 12:13 PM

This command runs some SQL on a remote D1 database. It works regardless of where the database is linked. If that database is linked to Pages then yes this will work.

Leo•1/13/25, 8:57 PM

Why is the number of read rows so high again? For 24 hours, I managed to optimize my database by adding indexes, but since 5 P.M. UTC everything is like before.

Leo•1/13/25, 8:57 PM

The number of queries did not grow btw and the site usage is like normal.

LLeo Why is the number of read rows so high again? For 24 hours, I managed to optimiz...

lambrospetrou•1/13/25, 9:09 PM

Are you sure your changes on the index are applied? The workload before and after don't seem similar since pre-17:00 it's close to zero basically.
What is your database ID?

Llambrospetrou Are you sure your changes on the index are applied? The workload before and afte...

Leo•1/13/25, 9:10 PM

c35ed856-6db5-4c84-8ed4-f1da79b17926

Leo•1/13/25, 9:11 PM

I'm also confused af

LLeo c35ed856-6db5-4c84-8ed4-f1da79b17926

lambrospetrou•1/13/25, 9:16 PM

Your database is fine, no errors at all. You have two SELECT queries that are causing this I think probably due to lack of index. Make sure you applied your changes/optimizations on the remote database and you didn't only update a local test database if using wrangler.

Leo•1/13/25, 9:17 PM

I used the web dashboard to directly apply these changes to prod, and everything was fine until 17:00

LLeo I used the web dashboard to directly apply these changes to prod, and everything...

lambrospetrou•1/13/25, 9:19 PM

Check the D1 insights in the dashboard for slow queries to see your slow queries and confirm if the indexes you added apply to those queries (their where filters).

Leo•1/13/25, 9:22 PM

I can't find the insights you mean, I just have:

Tables
Console
Time Travel
Metrics
Settings

LLeo I can't find the insights you mean, I just have: Tables Console Time Travel Met...

lambrospetrou•1/13/25, 9:23 PM

Ah, they are through the API or wrangler: https://developers.cloudflare.com/d1/observability/metrics-analytics/#query-insights

Leo•1/13/25, 9:29 PM

The indexes worked yesterday and if I query the DB using the dashboard, a fairly normal row count appears... and I did not change anything since 12:00 today. I still don't see where the issue is and how to optimize these away.

Thanks for the insights btw

LLeo The indexes worked yesterday and if I query the DB using the dashboard, a fairly...

lambrospetrou•1/13/25, 9:35 PM

If you copy paste your slowest query in your D1 console dashboard and run it prefixed with

EXPLAIN

EXPLAIN

you are hopefully going to see if the database does a scan or if it's uses an index.
There isn't anything problematic with your database either way or a broader issue, so it's something with the query.

Leo•1/13/25, 9:35 PM

Ok, thank you, I'll take a look on this tomorrow.

Devils•1/13/25, 11:26 PM

Anyway to cluster multiple D1 Databases together, or would I essentially have to create custom middleware?

Devils•1/13/25, 11:28 PM

Looking to scale, but I'd rather just migrate over to something like YugabyteDB or TiDB and host my own database infastructure if I'm going to have to make custom middleware.

DDevils Anyway to cluster multiple D1 Databases together, or would I essentially have to...

1984 Ford Laser•1/13/25, 11:31 PM

Most of Cloudflare's dev platform requires some sort of custom middleware at some point. Durable Objects might be a solution to your problem, but again you'll need some amount of custom middleware

11984 Ford Laser Most of Cloudflare's dev platform requires some sort of custom middleware at som...

Devils•1/13/25, 11:32 PM

Interesting, great to know now than later.. didn't want to dig to deep into something that I'm just going to have to migrate away from anyways.

Devils•1/13/25, 11:32 PM

Working on API layers so.

Devils•1/13/25, 11:32 PM

Devils•1/13/25, 11:35 PM

The only products from Cloudflare I've really implemented is R2, coming from Backblaze, the costs for R2 are a lot cheaper. I had no idea that most of the products actually needed workers and stuff to work out of the box.

1984 Ford Laser•1/13/25, 11:37 PM

The idea is that you can build the system to work exactly how you need it. That might not work for every use case, but it means you have so much freedom to build to suit your use case

11984 Ford Laser The idea is that you can build the system to work exactly how you need it. That ...

Devils•1/13/25, 11:38 PM

I think its just the fact that not only are you paying for D1 costs, but workers as well. Nonetheless I can understand it. Thanks my friend.

Chris Jayden•1/14/25, 8:56 AM

I just found out about the 10 GB limit on D1. And I think I'll need at least 30-50gb.

I know D1's can horizontally scale but I can't find any docs on how you would create a D1 instance per tentant/organization in a worker. Does anyone has any examples or docs they could point to?

CChris Jayden I just found out about the 10 GB limit on D1. And I think I'll need at least 30-...

lambrospetrou•1/14/25, 9:22 AM

At the moment you cannot create D1 databases dynamically within your worker code. You need to create one through the D1 Rest API or the dashboard, and then add it in your wrangler.toml (and/or dynamically patch your worker on the fly).

So, in your case you probably just need to create 5-10 dbs and add them in your wrangler.

There is no automatic migration of the data from your existing DB to those new dbs, just to be clear though.

Llambrospetrou At the moment you cannot create D1 databases dynamically within your worker code...

Chris Jayden•1/14/25, 9:27 AM

Thanks for your quick answer. I think I'll be switching from D1 to a database that has a higher limit, until Workers can dynamically handle new D1 instances for tenants.

Chris Jayden•1/14/25, 9:29 AM

~~I did see in the docs just now that you can increase a limit, but there's not much information regarding that; https://developers.cloudflare.com/d1/platform/limits/~~

Actually, scratch that, the docs say

Note that the 10 GB limit of a D1 database cannot be further increased.

CChris Jayden Thanks for your quick answer. I think I'll be switching from D1 to a database th...

lambrospetrou•1/14/25, 9:30 AM

BTW, Durable Objects are the same underlying SQL engine, and you can create as many of those as you need just within your Worker code, so if that works for you, it would probably be less work than migrating to a whole other system.

Llambrospetrou BTW, Durable Objects are the same underlying SQL engine, and you can create as m...

Chris Jayden•1/14/25, 9:34 AM

That's interesting. What are the differences?

Chris Jayden•1/14/25, 9:35 AM

I see the sqlite is quite a recent thing in DO? https://developers.cloudflare.com/durable-objects/best-practices/access-durable-objects-storage/#sqlite-storage-backend

Chris Jayden•1/14/25, 9:36 AM

This is a helpful blog I just found that helps to explain that use case a bit more; https://www.lambrospetrou.com/articles/durable-objects-cloudflare/

Lambros Petrou personal website

Durable Objects (DO) — Unlimited single-threaded servers spread acr...

Understand Cloudflare Durable Objects and use them to simplify your architecture.

True, that may be R2. We do get some D1 errors periodically, sent you some examples on DM. Might be

Similar Threads

Similar Threads

Similar Threads