Hello, we have the exact same issue. Queries fail, dashboard fails, can't turn off replication even

Hello, we have the exact same issue. Queries fail, dashboard fails, can't turn off replication even with the API, it returns this

{"errors":[{"code":7500,"message":"internal error; reference = e_PVSMDp_a7bf1e15234b4277b9f32a19516fdc30"}],"success":false,"messages":[],"result":null}

{"errors":[{"code":7500,"message":"internal error; reference = e_PVSMDp_a7bf1e15234b4277b9f32a19516fdc30"}],"success":false,"messages":[],"result":null}

{"errors":[{"code":7500,"message":"internal error; reference = e_PVSMDp_a7bf1e15234b4277b9f32a19516fdc30"}],"success":false,"messages":[],"result":null}

{"errors":[{"code":7500,"message":"internal error; reference = e_PVSMDp_a7bf1e15234b4277b9f32a19516fdc30"}],"success":false,"messages":[],"result":null}

the database id is 943219ad-705a-4a47-a87d-9b56e1b8e7ea
Thank you

NikolasOP•4/11/25, 5:09 PM

Also I was wondering why nothing is mentioned in cloudflarestatus.com

NikolasOP•4/11/25, 5:09 PM

is it not affecting everyone?

NNikolas Hello, we have the exact same issue. Queries fail, dashboard fails, can't turn o...

Milan•4/11/25, 6:41 PM

Are you sending a bunch of requests at once? Just curious

Milan•4/11/25, 6:42 PM

What happens if you send a single request, then wait a minute or so

MMilan Are you sending a bunch of requests at once? Just curious

NikolasOP•4/11/25, 6:43 PM

what kind of requests? For the api to disable replication or query requests?

Milan•4/11/25, 6:43 PM

A request to your DB

NikolasOP•4/11/25, 6:45 PM

its hooked up to Workers as an api for our app. And all the db related requests fail

NNikolas its hooked up to Workers as an api for our app. And all the db related requests ...

Milan•4/11/25, 6:46 PM

Your production DB is down?

NikolasOP•4/11/25, 6:46 PM

well, yes

NikolasOP•4/11/25, 6:46 PM

since we enabled replication

Milan•4/11/25, 6:47 PM

okay, we'll disable replication on our end for your account, one sec

NikolasOP•4/11/25, 6:48 PM

Thanks. I think you should just disable it for everyone until you fix this. Because it locks up the whole database and its options

Milan•4/11/25, 6:50 PM

Is your DB working?

NikolasOP•4/11/25, 6:51 PM

now it works, yes

NikolasOP•4/11/25, 6:51 PM

thanks again

Milan•4/11/25, 6:51 PM

I want to stress this again. Do not deploy beta products to your production service. It's in beta for a reason. @lambrospetrou can we pin this message somewhere?

NikolasOP•4/11/25, 6:51 PM

but it didnt say beta when we enabled it...

NikolasOP•4/11/25, 6:52 PM

we had no idea you launched this yesterday

NikolasOP•4/11/25, 6:52 PM

and it said it would just improve the db latency so why not enable it?

Original message was deleted

Isaac McFadyen•4/11/25, 6:55 PM

IIRC that's newly added, it wasn't there at launch.

NikolasOP•4/11/25, 6:55 PM

yes

NikolasOP•4/11/25, 6:55 PM

it wasn't there

NikolasOP•4/11/25, 6:59 PM

also someone would assume that an option can be disabled if needed.. Wrong assumption I guess

MMilan I want to stress this again. Do not deploy beta products to your production serv...

Chaika•4/11/25, 7:06 PM

should perhaps be a popup on enabling it, asking for confirmation "Read Replication is in beta and can take hours to disable after enabling. Only enable for non-production/in testing" or something like that

Chaika•4/11/25, 7:06 PM

it'd be way less of an issue if disabling it was instant/always worked

Milan•4/11/25, 7:08 PM

Disabling does work. We're currently working on fixes for a few known bugs (some new ones as of going public), your DB hit one of them @Nikolas. To be clear, not all replicated DBs will hit these problems, but when DBs do hit these problems we intend to patch the issues as quickly as we can.

As is mentioned in the blog, it's really important to verify that these things work for your use case prior to releasing them to production. Even with products that are GA, it's critical to understand what you're releasing.

MMilan I want to stress this again. Do not deploy beta products to your production serv...

Chaika•4/11/25, 7:15 PM

we can pin messages in channels. Do you want just that message pinned, or something more exact?

Chaika•4/11/25, 7:16 PM

like "D1 Read Replication is in beta and not recommended for production use. Exercise care when enabling before releasing to production"?

CChaika we can pin messages in channels. Do you want just that message pinned, or someth...

lambrospetrou•4/11/25, 7:19 PM

D1 Read replication is in BETA. Do not enable directly in production without testing in a staging/test environment for a few days to ensure it works fine for your workload. The D1 team is aware of certain issues leading to continuous errors for some users, and are working on a fix.

AtesMAE•4/11/25, 7:19 PM

I have a problem, where can I get support

James•4/11/25, 7:29 PM

What kind of problem? What do you need support for? If it's for D1 as per this channel, you can simply ask your question or state your problem and someone will get back to you. If it's something else, check the other channels in the server.

AtesMAE•4/11/25, 7:30 PM

could not run legacy post zone sub request against new zone products: failed to update user subscription: failed to apply object products: You cannot add or modify subscriptions or services until the outstanding balance is paid. You should be able to do so in your Billing page.

AtesMAE•4/11/25, 7:30 PM

i need help

AAtesMAE could not run legacy post zone sub request against new zone products: failed to ...

Isaac McFadyen•4/11/25, 7:31 PM

?billing See below

SuperHelpflare•4/11/25, 7:31 PM

Cloudflare's billing system is undergoing some changes/migration. During this period, you may notice extra bills, incorrect bills, or other issues.

To resolve these issues, create a Support ticket by using the following link (you must be logged into your Cloudflare account): https://dash.cloudflare.com/?to=/:account/support

Note that all accounts, even Free plan accounts, can create billing tickets. Tickets are the only way to resolve billing issues; we cannot help you in this Discord.

ajgeiss0702•4/12/25, 2:49 AM

i'm still getting errors occasionally with 5 retries

Aajgeiss0702 i'm still getting errors occasionally with 5 retries

Milan•4/12/25, 3:41 PM

For replication? We are working on a couple of bug fixes we're hoping to get out midway through this coming week

Deltachaos•4/12/25, 11:19 PM

regarding the limits: if i want to run a query like this:
update foo set bar = 1 where id not in (?)update foo set bar = 1 where id not in (?)
how do i bind a list as paramter? or do i need to do this?
update foo set bar = 1 where id not in (?, ?, ?, ?)update foo set bar = 1 where id not in (?, ?, ?, ?)

DDeltachaos regarding the limits: if i want to run a query like this: `update foo set bar = ...

lambrospetrou•4/13/25, 6:40 AM

The latter.

MMilan For replication? We are working on a couple of bug fixes we're hoping to get out...

ajgeiss0702•4/13/25, 8:18 PM

thank you. Will there be any kind of notification when these fixes are rolled out? Or should I just keep an eye on this channel

kapitein syantje•4/13/25, 8:58 PM

Hi, my production database was accidentally deleted whilst executing migrations. Not sure how it happened. I have the ID of the production database as well as the binding, is there a way to revert this?

Kkapitein syantje Hi, my production database was accidentally deleted whilst executing migrations....

Milan•4/13/25, 9:25 PM

I don't work on D1 but I would assume https://developers.cloudflare.com/d1/reference/time-travel/ is a good place to start, otherwise open a support ticket?

Cloudflare Docs

Time Travel and backups · Cloudflare D1 docs

Time Travel is D1's approach to backups and point-in-time-recovery, and allows you to restore a database to any minute within the last 30 days.

Aajgeiss0702 thank you. Will there be any kind of notification when these fixes are rolled ou...

Milan•4/13/25, 9:26 PM

I would probably say keep an eye on this channel (we will make noise), but also we'll probably remove some banners we've added around the UI here and there

MMilan I don't work on D1 but I would assume https://developers.cloudflare.com/d1/refer...

kapitein syantje•4/13/25, 9:26 PM

Hi Milan, thank you for your response. My first bet was to use time travel indeed, however, I cannot reference the database as it was deleted. I cannot time travel if the DB is deleted in Cloudflare apparantly.

Hopefully nothing is permanent, not the most fun to experience at midnight

MMilan I would probably say keep an eye on this channel (we will make noise), but also ...

ajgeiss0702•4/13/25, 9:27 PM

ok, thank you. I'll try to check this channel every few days

I've basically already been doing that anyway

Kkapitein syantje Hi Milan, thank you for your response. My first bet was to use time travel indee...

Milan•4/13/25, 9:29 PM

You mean you went into the UI/API and deleted the DB outright?

MMilan You mean you went into the UI/API and deleted the DB outright?

kapitein syantje•4/13/25, 9:30 PM

I suppose so? I was simply doing migrations using drizzle, and it probably did an API call deleting the db. I did not directly delete the DB through UI/API

kapitein syantje•4/13/25, 9:34 PM

Can confirm an API request went through, just checked the audit log... very curious

Milan•4/13/25, 9:35 PM

I've started a thread internally, is this DB critical for your service?

kapitein syantje•4/13/25, 9:36 PM

Very much so I'm afraid. The service runs mainly on the D1 db.

Hello, we have the exact same issue. Queries fail, dashboard fails, can't turn off replication even

Similar Threads