Cloudflare Developers•3y ago

Inside a DO? Is Hono looking for the Env in the right place? I would file a bug against Hono.

Bbret_pat The docs say that D1 is currently in alpha https://developers.cloudflare.com/wo...

Matt SilverlockOP•9/29/23, 8:28 AM

It’s in beta. Just missed that one page in the update.

joel•9/29/23, 8:29 AM

I somehow fixed it but have no clue how.

Steps:

Install Hono-do and add the bindings
Copy paste the example
For some reason it worked
I renamed the example class and added my code to it
I removed Hono-do again

I do not what is different than before now since it looks 1:1 the same, maybe that helps someone

joel•9/29/23, 8:29 AM

https://github.com/sor4chi/hono-do

GitHub

GitHub - sor4chi/hono-do: A wrapper of Cloudflare Workers's Durable...

A wrapper of Cloudflare Workers's Durable Object for Hono. - GitHub - sor4chi/hono-do: A wrapper of Cloudflare Workers's Durable Object for Hono.

AAdi > One of the biggest impediments to double-digit-gigabyte databases is performan...

Matt SilverlockOP•9/29/23, 8:56 AM

Double digits makes sense. 100GB per database is just a very different thing. But that’s also the point: orgs are used to large, monolithic databases, which makes changes and management risky. Many of us know what it’s like to have a database related incident caused by another team’s work or load.

A dominant reason everyone has big 100GB+ databases is because the cost of managing multiple database instances - the cost in operations AND dollars - is very high. You still pay by the hour. They take time to spin up. Managing backups is harder.

We think it’s going to be better for a lot of folks building new infrastructure to have 10+ 10GB D1 databases vs 1x 100GB database. And if you have legacy infrastructure, use Hyperdrive.

MMatt Silverlock Double digits makes sense. 100GB _per database_ is just a very different thing. ...

Adi•9/29/23, 9:19 AM

Thanks Matt, that makes a lot of sense. This definitely gave me a lot of clarity in how I'm thinking around future proofing products I'm building with D1

Jjoel I somehow fixed it but have no clue how. Steps: 1. Install Hono-do and add the...

Max (@rozenmd)•9/29/23, 9:30 AM

I've never heard of

hono-do

hono-do

, but the line above the install info is:

This is a work in progress. The code is not yet ready for production use.

Hono provides an example of using durable objects here: https://github.com/honojs/examples/tree/main/durable-objects

Old Man Maker•9/29/23, 9:50 AM

Probably already on a list somewhere, but would love the dashboard to show the primary key marked column

OOld Man Maker Probably already on a list somewhere, but would love the dashboard to show the p...

Max (@rozenmd)•9/29/23, 10:36 AM

it isn't actually, i'll add it to the backlog

MMatt Silverlock Inside a DO? Is Hono looking for the Env in the right place? I would file a bug ...

DanTheGoodman•9/29/23, 12:07 PM

That was like 8 months ago… I’m sure it’s changed

Max (@rozenmd)•9/29/23, 12:15 PM

Yeah at some point DOs couldn't talk to D1

DDanTheGoodman That was like 8 months ago… I’m sure it’s changed

Matt SilverlockOP•9/29/23, 1:51 PM

Ugh: Discord made it look like it was today

MMatt Silverlock Ugh: Discord made it look like it was today 🙃

DanTheGoodman•9/29/23, 2:07 PM

Someone replied to it yesterday

Laurent Pellegrino•9/29/23, 4:24 PM

Hello!

Is there any official docs about how to make transactions with D1? I can only find this old blog post: https://blog.cloudflare.com/whats-new-with-d1/

Laurent Pellegrino•9/29/23, 4:30 PM

How to increment a counter value stored as column in a row by 1 atomically?

Laurent Pellegrino•9/29/23, 4:30 PM

Is that supported?

Laurent Pellegrino•9/29/23, 4:48 PM

Interesting. Thanks a lot.

Laurent Pellegrino•9/29/23, 4:55 PM

Loving how D1 looks so far. I have a unique use case and need some guidance. I'm working with a database that contains roughly 50M entries. Interestingly, this database is updated only once every day, and after that, we only perform read operations. I'm curious – is there a method to either import an SQL backup or establish the database locally and then migrate it to D1, without incurring charges for the 50M writes daily? Appreciate any insights on this!

Laurent Pellegrino•9/29/23, 8:50 PM

Do you plan to keep the manual backup commands with wrangler on GA?

Laurent Pellegrino•9/29/23, 8:51 PM

Does a backup restore (not using time traval) incurs a charge (i.e. does it rows as writes)?

LLaurent Pellegrino Does a backup restore (not using time traval) incurs a charge (i.e. does it rows...

Max (@rozenmd)•9/29/23, 9:13 PM

The backup commands are from a time when it was necessary to do backups with D1. Time travel lets you rollback commit by commit, so it's not as useful.

Laurent Pellegrino•9/29/23, 9:14 PM

@rozenmd I am asking because of the use case I described just above.

Laurent Pellegrino•9/29/23, 9:16 PM

I'd be willing to shell out $0.1 per million writes for my situation, but $1 per million writes is certainly off-putting.

Old Man Maker•9/30/23, 2:02 AM

Hey, can someone help me understand the D1 insert SQL a little better please.

I have an object def that looks like this:

interface DetailsDataType{
    description:string,
    ref:string //Primary Key in Table
}

interface DetailsDataType{
    description:string,
    ref:string //Primary Key in Table
}

I'm getting an array of these objects that I want to insert into my D1.

I get how to inject a single string, but the object array is not happening for me.
I assume there is some shorthand way of doing this, don't want to put an ugly for loop in there.

This is the INSERT code, where the bind statement is incorrect because descData is an array:

descData: DetailsDataType[] = <ARRAY OF OBJECTS>;

const { results } = await c.env.DATABASE.prepare("INSERT INTO details (ref, description) VALUES (?, ?) RETURNING *")
        .bind(descData.description, descData.ref)
        .run()

const { results } = await c.env.DATABASE.prepare("INSERT INTO details (ref, description) VALUES (?, ?) RETURNING *")
        .bind(descData.description, descData.ref)
        .run()

Can this even be done this way?

Old Man Maker•9/30/23, 2:24 AM

I'm assuming I will need to use the Batching statement?

Old Man Maker•9/30/23, 2:42 AM

Ok - just got this to work with a looping batcher. Pretty sweet.

Can I make a suggestion please - if the use of hyphens '-' in names is causing so many issues, why not just blanket ban the use in any named object.

It just took me 10 mins to spot the issue with the table name, when it should have been rejected as a valid table name at the point of creation. Perhaps the wrangler tool does this, but the dashboard does not.

Thoughts?

franz101•9/30/23, 11:34 AM

What's the best practices for an ETL to export data from D1?

Ffranz101 What's the best practices for an ETL to export data from D1?

Dahoom•9/30/23, 11:37 AM

For the beta I'm currenly using community member nora's repo https://github.com/nora-soderlund/cloudflare-d1-backups

GitHub

GitHub - nora-soderlund/cloudflare-d1-backups: A package to dump a ...

A package to dump a copy of your experimental D1 database through a worker. - GitHub - nora-soderlund/cloudflare-d1-backups: A package to dump a copy of your experimental D1 database through a worker.

Dahoom•9/30/23, 11:38 AM

it works pretty well but I dont think there is any official system the beta system yet

franz101•9/30/23, 11:44 AM

Ah interesting I saw the dump function. I was curious as I was wondering about a local python connection to query the db. I guess you would need a worker that evals the query. I'm testing d1 for my ai news aggregator:
https://ml-news-liard.vercel.app/

Ffranz101 Ah interesting I saw the dump function. I was curious as I was wondering about a...

Dahoom•9/30/23, 11:49 AM

You probably need a worker yeah, I know for a fact you can connect directly to turso currently with libsql

Jason Hostetter•9/30/23, 3:25 PM

Is it correct that there is no way to programmatically create or connect to different databases for users without an enterprise account?

JJason Hostetter Is it correct that there is no way to programmatically create or connect to diff...

Cyb3r-Jak3•9/30/23, 3:30 PM

I'm pretty sure even with enterprise you can't

Jason Hostetter•9/30/23, 3:32 PM

There was mention of creating one db per client in the beta announcement, but only for enterprise

Cyb3r-Jak3•9/30/23, 3:32 PM

Oh workers for platforms

Jason Hostetter•9/30/23, 3:32 PM

Although the description wasn’t super clear to me

Jason Hostetter•9/30/23, 3:32 PM

Yeah

Cyb3r-Jak3•9/30/23, 3:33 PM

Yeah, sorry haven't used WfP but that will allow you to

Jason Hostetter•9/30/23, 3:34 PM

Is workers for platforms enterprise only?

Cyb3r-Jak3•9/30/23, 3:35 PM

It is

Jason Hostetter•9/30/23, 3:35 PM

Bahhh

Jason Hostetter•9/30/23, 3:38 PM

Ok well, maybe I’ll have to try to hack something together with turso or something

JJason Hostetter Is it correct that there is no way to programmatically create or connect to diff...

Matt SilverlockOP•9/30/23, 4:01 PM

You can programmatically create databases - the D1 API isn’t limited to enterprise accounts at all. There is a limit on the # of DBs you create (at the moment) on regular accounts but we will increase this very soon

Jason Hostetter•9/30/23, 4:14 PM

Oh nice! Can I dynamically bind a database depending on some parameter or key passed in the request to the worker?

JJason Hostetter Oh nice! Can I dynamically bind a database depending on some parameter or key pa...

Matt SilverlockOP•9/30/23, 4:17 PM

No, that is something we don’t yet support. Working on it. If you can bind any resource in your account it would break the security model (how do you bind only the right things?) - so the work is focused on APIs to help group/tag resources vs “any”

Jason Hostetter•9/30/23, 4:37 PM

Great to hear, looking forward to it. Was worried that functionality would be locked behind enterprise, which would effectively kill my project (at least with D1)

Inside a DO? Is Hono looking for the Env in the right place? I would file a bug against Hono.

Similar Threads

Similar Threads

Similar Threads