hey y'all - we're experiencing intermittent `D1_ERROR: Network connection lost`'s in our Workers hit

hey y'all - we're experiencing intermittent

D1_ERROR: Network connection lost

D1_ERROR: Network connection lost

D1_ERROR: Network connection lost

D1_ERROR: Network connection lost's in our Workers hitting D1.

New storage backend
Seems to be intermittent + random, there's no one query w/ 100% failure rate or anything - just scattered.
This is a higher-volume (I believe, compared to typical workloads) D1 DB, serving >50 queries/s

Does anyone have any idea if this is a D1 issue/an issue with our queries/DB, and if there's anything we can do? We're 100% aware D1 is still open alpha, just trying to get our success rate as close to 100% as possible

ColinOP•7/28/23, 3:47 PM

originally submitted a support ticket but was redirected here to chat with y'all

CColin hey y'all - we're experiencing intermittent `D1_ERROR: Network connection lost`'...

Matt Silverlock•7/28/23, 3:53 PM

What is the result set size / how many rows x bytes wide are you trying to return? Do you a database ID?

ColinOP•7/28/23, 3:55 PM

Sure, e707d84e-7dd9-4c4b-940a-63ea75a981fb is the ID. I’m on my phone right now so can’t be precise w/ result set size, but it’s definitely no more than 100 rows each being at most 512 bytes

CColin Sure, e707d84e-7dd9-4c4b-940a-63ea75a981fb is the ID. I’m on my phone right now ...

Matt Silverlock•7/28/23, 4:34 PM

Got it. Account ID would be great too. I don't see any immediate logs for e707d84e-7dd9-4c4b-940a-63ea75a981fbe707d84e-7dd9-4c4b-940a-63ea75a981fb

MMatt Silverlock Got it. Account ID would be great too. I don't see any immediate logs for `e707d...

ColinOP•7/28/23, 4:39 PM

Sure.
Account ID: cfd355bcff7e6af6838743ae944184b0cfd355bcff7e6af6838743ae944184b0
DB ID: e707d84e-7dd9-4c4b-940a-63ea75a981fbe707d84e-7dd9-4c4b-940a-63ea75a981fb

And some extras: Ray ID of a failed request: 7ecd59bfdc728ec87ecd59bfdc728ec8, timestamps are 16903819315021690381931502 (request) and 16903819365561690381936556 (D1 error)

ColinOP•7/28/23, 4:40 PM

Happy to add you on Discord + provide exact queries/source code if it'd help too

benjamin•7/28/23, 8:48 PM

Referencing this blog post (https://blog.cloudflare.com/whats-new-with-d1/), wondering about the plans for implementing procedures. I saw some references that this isn't in development/available (https://discord.com/channels/595317990191398933/789155108529111069/1104131881194246334).

Discord

Discord - A New Way to Chat with Friends & Communities

Discord is the easiest way to communicate over voice, video, and text. Chat, hang out, and stay close with your friends and communities.

codebam•7/29/23, 2:52 AM

does d1 support foreign keys?

Ccodebam does d1 support foreign keys?

Cyb3r-Jak3•7/29/23, 2:54 AM

Yeah it does. See WIP docs d1-database

CCyb3r-Jak3 Yeah it does. See WIP docs https://discord.com/channels/595317990191398933/99206...

codebam•7/29/23, 2:55 AM

thank you

codebam•7/29/23, 2:56 AM

what about auto increment? is that supported or do I just have to use random uuids?

Hyper•7/29/23, 3:51 AM

Hey guys. Im wondering when transactions will be supported on D1. Would love to be able to simplify database integrity maintenance

Ccodebam what about auto increment? is that supported or do I just have to use random uui...

Matt Silverlock•7/29/23, 11:43 AM

By default there is an automatic rowid column. You can also specify your own col_name INT PRIMARY KEYcol_name INT PRIMARY KEY which will also be auto incrementing. We haven’t yet published docs on this, but this applies: https://www.sqlite.org/rowidtable.html

HHyper Hey guys. Im wondering when transactions will be supported on D1. Would love to ...

Matt Silverlock•7/29/23, 11:43 AM

Do you mean JS transactions? We don’t have an ETA we can share.

MMatt Silverlock Do you mean JS transactions? We don’t have an ETA we can share.

Hyper•7/29/23, 12:07 PM

I’m a little confused. I thought transactions were not supported at all. Does this mean I can write transactions in SQL and they would work fine? For example if i’m using an orm that generates SQL of the transaction and executes it against D1, will that work normally?

HHyper I’m a little confused. I thought transactions were not supported at all. Does th...

Matt Silverlock•7/29/23, 1:10 PM

All queries are in an implicit transaction for D1.

HHyper I’m a little confused. I thought transactions were not supported at all. Does th...

Matt Silverlock•7/29/23, 1:11 PM

Some folks want a separate, callback-driven JS API that allows you to combine SQL + JS —> that part is further out.

Hyper•7/29/23, 6:29 PM

Gotcha