I am working on an app and I plan to use a durable object per team (group of users). For this I'll u

I am working on an app and I plan to use a durable object per team (group of users). For this I'll use the team-id as the unique name for instance

const id = this.env.MY_DURABLE_OBJECT.idFromName(teamId);
const stub = this.env.MY_DURABLE_OBJECT.get(id);

const id = this.env.MY_DURABLE_OBJECT.idFromName(teamId);
const stub = this.env.MY_DURABLE_OBJECT.get(id);

const id = this.env.MY_DURABLE_OBJECT.idFromName(teamId);
const stub = this.env.MY_DURABLE_OBJECT.get(id);

const id = this.env.MY_DURABLE_OBJECT.idFromName(teamId);
const stub = this.env.MY_DURABLE_OBJECT.get(id);

But how should I manage auth? Shouldn't auth hit a single DB?

Should I be using D1 for tables like - users, teams, etc (other global tables) and DO for tables specific to the team?

Ccj I am working on an app and I plan to use a durable object per team (group of use...

James•3/15/25, 12:58 PM

I would personally stick to and recommend something more traditional and external for auth and global info. Postgres + Hyperdive for example works great.

Cloudflare’s recommendation to build horizontally with D1 and DO SQL just doesn’t really work in my experience in the real world, coupled with the reliability issues and support concerns with D1: https://www.reddit.com/r/CloudFlare/s/4D9AeoAHm0

JJames I would personally stick to and recommend something more traditional and externa...

cjOP•3/15/25, 1:06 PM

Thank you. I didn't see anyone building auth on top of D1. And so the question.

James•3/15/25, 3:52 PM

I use a central db for auth, but they only need to hit that when the session expires, as well I only store data there for central lookups. Sessions are kept in DO per user, bypassing central db for a faster request avg.

will smith•3/16/25, 12:51 AM

status dashboard says no, but just for my sanity there's no known issue with d1 is there?
getting sudden huge spikes in latency (47,000ms) for very simple requests which were fine previously

    const findActivityStartTime = performance.now();
    const activity = await prisma.activity.findFirst({
      where: {
        id: activityId,
        goalId: goalId,
        goal: {
          userId: user.id,
        },
      },
    });
    const findActivityEndTime = performance.now();
    console.log(
      `Time to find activity: ${findActivityEndTime - findActivityStartTime}ms`
    );

    const findActivityStartTime = performance.now();
    const activity = await prisma.activity.findFirst({
      where: {
        id: activityId,
        goalId: goalId,
        goal: {
          userId: user.id,
        },
      },
    });
    const findActivityEndTime = performance.now();
    console.log(
      `Time to find activity: ${findActivityEndTime - findActivityStartTime}ms`
    );

I don't actually see the requests in the metrics page

Kotkoroid•3/17/25, 12:23 PM

Hi, how is it looking with stored procedures? https://blog.cloudflare.com/whats-new-with-d1/#sneak-peek-how-were-bringing-javascript-transactions-to-d1

I would like to write some JS code inside SQL database thus I can't use

batch()

batch()

but I cannot find any other resources than in this blog post.

Kotkoroid•3/17/25, 12:24 PM

Ok, I found this: https://community.cloudflare.com/t/d1-stored-procedures-can-not-use/649207/2

Kotkoroid•3/17/25, 12:25 PM

What is the current state in D1 to solve this?

KKotkoroid Hi, how is it looking with stored procedures? https://blog.cloudflare.com/whats-...

lambrospetrou•3/17/25, 1:59 PM

Not released, and no way to do that now. Ideally, try to design your queries not to need transactions interleaved with JS code.

flowwise•3/17/25, 3:31 PM

was anyone able to use Prisma + D1? My app works locally but when I deploy it to Cloudflare i'm getting the error: fs.readdir is not implemented yet. Why would Prisma need access to the filesystem if it is configured to connect to D1? Its a real showstopper for me. I guess i will have to self-host the app if there is no solution.

Boetro•3/17/25, 4:52 PM

Hi! I'm looking for some docs on how d1 handles a colo going doing? If the location housing my d1 database goes down am I just hosed until it comes back up or is their some kind of built in failover?

Zack•3/17/25, 4:53 PM

Hey, I recently moved some of our infra from KV to D1, with a database situated in every location to be nearer to the user while awaiting global replication. This was working great, however after updating that data through our warming process (import all new data into a tmp database, rename old database, rename new database to old database name, drop old database), the databases all appear to be experiencing significant random latency issues. In our monitoring I can see average duration to call D1 jumping from ~20-50ms depending on worker location to some queries hanging for multiple seconds up to a minute. I'm wondering if someone can help me investigate what is going on here. Beyond completely recreating all these databases as part of our warming process I am not sure what the option is here. Our database is ~2GB in size and has 3.24 million rows. I am wondering if there's something going on internally like DO resets that is causing this behaviour. I've attached an example graph where you can see the moment the warming happened and the duration metrics afterwards. This is from the HKG PoP and with a D1 instance in APAC

Zack•3/17/25, 4:55 PM

BBoetro Hi! I'm looking for some docs on how d1 handles a colo going doing? If the locat...

lambrospetrou•3/17/25, 6:59 PM

D1 is built ontop of Durable Objects (DO). It's true that once the colo hosting the Durable Object for your database there will be some downtime. But, the Durable Objects platform will move your database DO on a healthy colo/server as soon as the faulty colo is detected by the automation and taken out of the network. Depending on how severe the issue is this move could take seconds or a few minutes. Usually there shouldn't be much of a downtime for this reason.

Unfortunately, most of the errors you will encounter are transient and sporadic, not a whole colo going down. In those cases, making your queries idempotent and having some retries will greatly help.

ZZack Hey, I recently moved some of our infra from KV to D1, with a database situated ...

lambrospetrou•3/17/25, 7:02 PM

You need to provide us database IDs to be able to look anything for you.
Also, some details on volume, queries, how much data are you returning each time, etc are helpful.

This is from the HKG PoP and with a D1 instance in APAC

APAC is a huge region and you could be 100-200ms away from your database unfortunately. Having said that anything more than a few hundreds of ms even in those cases is a bigger unexpected issue, either with the responses getting back to your worker or something else.

Also, I assume you are using the Workers binding right? Not the REST API.

Llambrospetrou D1 is built ontop of Durable Objects (DO). It's true that once the colo hosting ...

Boetro•3/17/25, 7:03 PM

Thanks for the response exactly what I was looking for!

Llambrospetrou You need to provide us database IDs to be able to look anything for you. Also, s...

Zack•3/17/25, 7:17 PM

Just heading back to my office, will get those to you shortly. Will throw them in a thread

SSaku75 Hey everyone, just a curious question, that i have been searching for an answer ...

lambrospetrou•3/17/25, 8:44 PM

If you need more than that, it's better to use Durable Objects directly, really. At least, at the current state of D1.

Ludo | Txtx•3/17/25, 10:05 PM

howdy! is it possible to have a worker W1 passing its binding to a Service worker W2?
I'd like to have to have a pool of workers, all bound to different D1 databases, being able to delegate the execution of the same logic to one worker (ideally a durable object) that I can upgrade easily

LLudo | Txtx howdy! is it possible to have a worker W1 passing its binding to a Service worke...

Isaac McFadyen•3/17/25, 10:06 PM

?crossposting

SuperHelpflare•3/17/25, 10:06 PM

Please do not post your question in multiple channels/post it multiple times per the rules at #

welcome-and-rules. It creates confusion for people trying to help you and doesn't get your issue or question solved any faster.

IIsaac McFadyen ?crossposting

Ludo | Txtx•3/17/25, 10:09 PM

I initially posted in workers-for-platform, which I don't think was the right one\

will smith•3/18/25, 1:43 AM

Any update on this? the db id should be in the metrics link
d1-database

Panoptikym•3/18/25, 2:42 AM

#d1-database

FFjordWarden How do I deal with OLTP workloads when using D1, I know that D1 does not suppor...

Burrito•3/18/25, 11:16 PM

D1 does support transactions: https://developers.cloudflare.com/d1/worker-api/d1-database/#batch

akazwz•3/19/25, 6:33 AM

Why is D1 overloaded? Is this product truly production-ready?

Aakazwz Why is D1 overloaded? Is this product truly production-ready?

lambrospetrou•3/19/25, 8:33 AM

D1 as a whole is not overloaded. Each individual database can be overloaded if you send time-consuming queries or thousands of queries per second.

Kite•3/19/25, 12:17 PM

Hey guys, does full text search or just search in general work for multi-tenant D1?

Kite•3/19/25, 12:17 PM

I'm wondering if it would make sense for applications like multi-vendor ecommerce

KKite Hey guys, does full text search or just search in general work for multi-tenant ...

lambrospetrou•3/19/25, 5:52 PM

D1 (and SQLite Durable Objects) support the FTS5 SQLite extension yes. https://developers.cloudflare.com/d1/sql-api/sql-statements/#supported-sqlite-extensions

anchor•3/20/25, 12:05 AM

Hi everyone,

I’m encountering an issue with my local Cloudflare Worker setup using Miniflare and SQLite. Is there a known issue or extra configuration needed for Miniflare to correctly bind and use a local SQLite file for D1?
How can I confirm that Miniflare is loading the correct database file and not creating an in-memory database?
Are there any additional debug flags or logs that might help diagnose this issue?

Jadugar_Jaggu•3/20/25, 6:08 AM

D1 having issues ?

JJadugar_Jaggu D1 having issues ?

Jadugar_Jaggu•3/20/25, 6:12 AM

Having D1 internal reference error @Community Champion
account id 0292f26a5978816ec7dd8d2838ddda52

Is it global issue?

Unsmart•3/20/25, 6:19 AM

?pings

SuperHelpflare•3/20/25, 6:19 AM

Please do not ping community members for non-moderation reasons. Doing so will not solve your issue faster and will make people less likely to want to help you.

JJadugar_Jaggu D1 having issues ?

itsmatteomanf•3/20/25, 8:44 AM

that is a relatively common error, it happens sometimes, you need to be able to catch it and retry...

will smith•3/21/25, 3:31 AM

Getting the same huge latency again, any updates? Workers id a3f6e70849e6eb5ca1ebaf6083bc84ba. d1-database

olafg•3/21/25, 1:55 PM

How are you supposed to setup wrangler (jsonc) to have a local development database and a production instance? Wrangler only supports production and preview as environments, but if I define a d1 binding on the top level it takes precedence over the one defined in the environment

Lucas•3/21/25, 4:15 PM

Does Cloudflare D1 support database connection pooling like Supabase or Neon?
If not, does Cloudflare D1 support something similar?
If not, it's not a good option to choose D1 instead Supabase or Neon, right? (also considering other issues like lack of transactions support)
If right, what could be a good purpose to use D1 instead Postgres?

LLucas Does Cloudflare D1 support database connection pooling like Supabase or Neon? If...

Chaika•3/21/25, 4:27 PM

Does Cloudflare D1 support database connection pooling like Supabase or Neon?

D1 is not postgres. It's sqlite, which doesn't have a remote connection protocol. You can connect via the Rest API( not recommended, goes through core/higher latency and api rate limits) or via Workers, which just make requests to your d1 instance.

If not, it's not a good option to choose D1 instead Supabase or Neon, right? (also considering other issues like lack of transactions support)

Supabase and Neon are both Postgres DBs. Compared to D1, they have more scaling options (D1 is locked to a single instance in a single region right now), higher max storage (D1 has a hard limit of 10 gb), and is postgres/instead of sqlite, less vendor lockin and such. So it's pretty different in general. D1 aims to have you scale with many DBs rather then one big one, but lacks the dynamic bindings to make that easy right now

Lucas•3/21/25, 4:28 PM

I know D1 is SQLite.

Chaika•3/21/25, 4:29 PM

You can use neon w/ Workers using Cloudflare's Hyperdrive connecting pooling/caching service: https://neon.tech/docs/guides/cloudflare-hyperdrive, or their connecting pooling

LLucas I know D1 is SQLite.

Chaika•3/21/25, 4:31 PM

Then maybe it helps to extend my answer: Since D1 is SQlite, Sqlite doesn't have external database connections/any connection protocol, there's no expensive db connections to be had. When your query your db from your worker, you're getting the best performance to d1 without having to do anything, under the hood it uses rpc/http, much less expensive connections then db connections, to connect and talk to your database

Lucas•3/21/25, 4:50 PM

@Chaika Ok, thank you.

masimo•3/21/25, 9:20 PM

According to docs:

D1 is designed for horizontal scale out across multiple, smaller (10 GB) databases, such as per-user, per-tenant or per-entity databases.

But I don't really see a way to dynamically bind to a D1 from a worker? How are per-user, per-tenant, or per-entity use cases actually covered? Any examples?

Mmasimo According to docs: > D1 is designed for horizontal scale out across multiple, sm...

Isaac McFadyen•3/21/25, 9:26 PM

There is no way to dynamically bind D1 databases yet, but it's coming in the future at some point.

masimo•3/21/25, 9:35 PM

I see, thank you. So if I understand, the per-user, per-tenant, or per-entity database use cases are covered by manually updating bindings to a worker and redeploying the worker?

I am working on an app and I plan to use a durable object per team (group of users). For this I'll u

Similar Threads

Similar Threads

Similar Threads