Cloudflare Developers•3y ago

Hello team Is there a way to dynamically create d1 databases per user and bind it to worker ?

Hello team

Is there a way to dynamically create d1 databases per user and bind it to worker ?

Ww3bcode Hello team Is there a way to dynamically create d1 databases per user and bind ...

Cyb3r-Jak3•11/2/23, 8:27 PM

Not yet but it is planned with no ETA.

Pascale•11/3/23, 1:04 AM

What database size can we expect once d1 leaves beta? We hit that 2GB limit fairly early

Paul Shriner•11/3/23, 1:47 AM

Pretty sure that D1 may be the last thing restored

Paul•11/3/23, 2:44 AM

I’ve got a huge pitch tomorrow at noon. I am praying to the cloudflare gods it’s all fixed by then

PPaul I’ve got a huge pitch tomorrow at noon. I am praying to the cloudflare gods it’s...

Paul Shriner•11/3/23, 2:48 AM

I have arleady rescheduled

AAlCalzone Is there a good way to import large amounts of data into D1? What I'm doing now ...

JuProxy•11/3/23, 3:42 AM

Same question here, would like to how a good way of importing data plus1green

VViper Is D1 currently down?

limikael•11/3/23, 7:25 AM

Came here to ask the exact same thing...

limikael•11/3/23, 7:28 AM

My symptoms are: My site currently works and it seems like it can access the database (so working so far)... However, when I try to deploy a new version I get an error: "binding DB of type d1 failed to generate. Please try again later or contact support. [code: 10021]". Also, when trying to go to the D1 page in the Dashboard it just loads indefinitely... Hopefully something temporary! Will try again in a few hours...

VViper Is D1 currently down?

Dan•11/3/23, 8:38 AM

was gonna ask the same. Can't create a new DB from the UI or via Wrangler

Max (@rozenmd)•11/3/23, 9:12 AM

D1 databases are still up, API operations seem to be impacted by https://www.cloudflarestatus.com/incidents/hm7491k53ppg

Cloudflare Dashboard and Cloudflare API service issues

MMax (@rozenmd)D1 databases are still up, API operations seem to be impacted by https://www.clo...

limikael•11/3/23, 9:28 AM

Thanks! Btw, how should error code 10021 be interpreted? I googled and also spent some time searching the docs but couldn't find anything...

kian•11/3/23, 9:30 AM

10021 is a very generic Workers API error

kian•11/3/23, 9:30 AM

Could be a syntax error in your script, internal error in the API, etc

MMax (@rozenmd)D1 databases are still up, API operations seem to be impacted by https://www.clo...

morpig•11/3/23, 9:35 AM

same thing happening to hyperdrive..

  binding HYPERDRIVE of type hyperdrive failed to generate: Failed to perform request against sqc-config: Get
  "https://sqc-config-production.sd.cfplat.com/apiv4/internal/databases/xxx/binding-user":
  dial tcp 198.41.251.57:443: i/o timeout (Client.Timeout exceeded while awaiting headers). [code:
  10021]

  binding HYPERDRIVE of type hyperdrive failed to generate: Failed to perform request against sqc-config: Get
  "https://sqc-config-production.sd.cfplat.com/apiv4/internal/databases/xxx/binding-user":
  dial tcp 198.41.251.57:443: i/o timeout (Client.Timeout exceeded while awaiting headers). [code:
  10021]

Ɇ₦ĐɆⱤV₳₥₱łⱤɆ•11/3/23, 9:36 AM

can’t wait for d1 v2.0.0, call it the sequel.

ɆɆ₦ĐɆⱤV₳₥₱łⱤɆ can’t wait for d1 v2.0.0, call it the sequel.

Max (@rozenmd)•11/3/23, 9:40 AM

https://tenor.com/view/fozzie-bear-wow-puppet-gif-11158378

Tenor

Ɇ₦ĐɆⱤV₳₥₱łⱤɆ•11/3/23, 9:41 AM

https://tenor.com/view/aladdin-genie-tough-crowd-gif-14528857

Tenor

Ɇ₦ĐɆⱤV₳₥₱łⱤɆ•11/3/23, 9:42 AM

tough crowd tonight

nazsolti•11/3/23, 10:03 AM

is D1 distributed as well?
I think I remember reading somewhere that it's not and is instead deployed to the closest datacenter to where you're initiating it, but I can't find it now, and now I wonder if I had dreamt this or something

Dahoom•11/3/23, 10:03 AM

there is no replication yet

Dahoom•11/3/23, 10:04 AM

although i heard it is coming soon

nazsolti•11/3/23, 10:04 AM

good to know, thanks

kian•11/3/23, 10:08 AM

You can provide location hints to create it in other regions rather than the closest one, but yeah - no replicas currently.

Kuririn•11/3/23, 10:10 AM

I want to create a new DB for each client, I guess best way it is to use CF API (https://developers.cloudflare.com/api/operations/cloudflare-d1-create-database). But then how could I dynamically query the selected DB from the worker? (I don't want to query via API, but somehow bind it dynamically if it's possible)

kian•11/3/23, 10:11 AM

There is no dynamic bindings available currently

kian•11/3/23, 10:12 AM

d1-database

Kuririn•11/3/23, 10:13 AM

ok, thanks

KKuririn I want to create a new DB for each client, I guess best way it is to use CF API ...

GuillaumeLakano•11/3/23, 10:25 AM

It's what we doing right now, the DB creation seems to works dynamically, but to inject the new D1 binding in the script, this not works for us ( workers-and-pages-helpworkers.api.error.invalid_script_config error 10202 )

GGuillaumeLakano It's what we doing right now, the DB creation seems to works dynamically, but to...

kian•11/3/23, 10:26 AM

It's a

PATCH

PATCH

, but not really - you need to

GET

GET

, upsert your new bindings, and then

PATCH

PATCH

with the full set of settings.

kian•11/3/23, 10:26 AM

You seem to be doing that, so what's the error?

Kkian It's a `PATCH`, but not really - you need to `GET`, upsert your new bindings, an...

GuillaumeLakano•11/3/23, 10:29 AM

yep, it's what I've done as explained in the message, but I always receive the same error.
I've tried to do a GET of full settings and then to inject the new bindings, and to apply with a PATCH ( in form-data )
I've also tried to only PATCH the settings object with only the 'bindings' array inside
The only things working is if I'm creating a new binding with only one entry, but all previous are destroyed ( and from a HTTP PATCH philosophy, this should be better to only PATCH and not replace like a HTTP PUT )

Kkian You seem to be doing that, so what's the error?

GuillaumeLakano•11/3/23, 10:30 AM

workers.api.error.invalid_script_config error 10202

GuillaumeLakano•11/3/23, 10:30 AM

workers-and-pages-helpworkers.api.error.invalid_script_config error 10202 ( the link of thread )

kian•11/3/23, 10:56 AM

The incident is still on-going at the moment. There is no ETA for when it will be resolved.

kian•11/3/23, 10:56 AM

You can follow https://www.cloudflarestatus.com/incidents/hm7491k53ppg for updates.

_tweak^prone•11/3/23, 11:12 AM

I was just about to make my first D1 database yesterday, when this incident hit

I was so excited to move stuff to CF - and then boom.

_tweak^prone•11/3/23, 11:14 AM

Anyone has experience with https://github.com/renoki-co/l1 ? Does it work "just as a wrapper" where migrations, models, eloquent etc from Laravel is still available ?

Paul Shriner•11/3/23, 11:14 AM

D1 is in beta, which means, "It's gonna break y'all" so do not make this mission critical. While it sucks, it also means that every other service is in front of it regarding restoration.

The said that the issue was a power outage, I am guessing that they have to restore from full backup and the adjust configurations.

I can only imagine the size of a cloudflare backup.

PPaul Shriner D1 is in beta, which means, "It's gonna break y'all" so do not make this mission...

_tweak^prone•11/3/23, 11:15 AM

Yearh, I bet they cant do with the 16tb synology i got rocking

Dahoom•11/3/23, 11:15 AM

I want to read the upcoming blog post from this incident, some very unexpected stuff has to happen if cloudflare API is down for this long

Matt Silverlock•11/3/23, 11:21 AM

We’re currently working on bringing the D1 API back up. As before, existing D1 deployments/databases continue to operate and were not impacted.

omar4289•11/3/23, 11:28 AM

Why do we have a lot of stability issues in Cloudflare ? Everyday, a new issue happens

__tweak^prone Anyone has experience with https://github.com/renoki-co/l1 ? Does it work "just ...

Pascale•11/3/23, 12:00 PM

I have tried it in a PoC - yes, exactly. as long as the generated SQL is compatible with Cloudflare, that should work as you think it would.

PPascale I have tried it in a PoC - yes, exactly. as long as the generated SQL is compati...

_tweak^prone•11/3/23, 12:03 PM

Nice, thanks

Oomar4289 Why do we have a lot of stability issues in Cloudflare ? Everyday, a new issue h...

GuillaumeLakano•11/3/23, 12:04 PM

May be the series law

But the good point is, each time, the staff take time to create a blog article to explain why, to explain how they fix it to prevent this happening again. Nothing is never perfect, but at least, they're transparent and try to improve each time on theses outages

binding HYPERDRIVE of type hyperdrive failed to generate: Failed to perform request against sqc-config: Get "https://sqc-config-production.sd.cfplat.com/apiv4/internal/databases/xxx/binding-user": dial tcp 198.41.251.57:443: i/o timeout (Client.Timeout exceeded while awaiting headers). [code: 10021]

Hello team Is there a way to dynamically create d1 databases per user and bind it to worker ?

Similar Threads

Similar Threads

Similar Threads