wen D2 (mongodb support)?

M

You can query MongoDB directly from a Worker: https://www.npmjs.com/package/mongodb-data-api (their HTTP API)

npm

MongoDB atlas data API SDK for Node.js. Latest version: 0.4.0, last published: 6 months ago. Start using mongodb-data-api in your project by running

npm i mongodb-data-api

npm i mongodb-data-api

npm i mongodb-data-api

npm i mongodb-data-api. There are 2 other projects in the npm registry using mongodb-data-api.

MMatt Silverlock You can query MongoDB directly from a Worker: https://www.npmjs.com/package/mong...

G

Gagan SuieOP•5/16/23, 9:14 PM

We're already using a data-api wrapper. The need for D2 MongoDb support is so our data is closer to workers and not scattered in other data centers.
https://github.com/saibotsivad/mongodb

GitHub

GitHub - saibotsivad/mongodb: Simple wrapper for the MongoDB Data API.

Simple wrapper for the MongoDB Data API. Contribute to saibotsivad/mongodb development by creating an account on GitHub.

GGagan Suie We're already using a data-api wrapper. The need for D2 MongoDb support is so ou...

M

Matt Silverlock•5/16/23, 9:48 PM

Got it. There's lots we can do here (over time) but I wouldn't mix up "D2" and "MongoDB" here

MMatt Silverlock Got it. There's lots we can do here (over time) but I wouldn't mix up "D2" and "...

G

Gagan SuieOP•5/16/23, 9:49 PM

ah got it. another cloudflare engineer called it D2. so i assumed it was a thing.

GGagan Suie ah got it. another cloudflare engineer called it D2. so i assumed it was a thing...

M

Matt Silverlock•5/16/23, 10:32 PM

Not sure where that's coming from — D2 isn't a thing, nor is hosting MongoDB

A

Advany•5/16/23, 11:09 PM

Our serverless SQL database, D1, launched in open alpha last year, and we’re continuing to invest in making it production ready (stay tuned for an exciting update later this week!).

W

Walshy•5/16/23, 11:09 PM

Go on Glen, leak it all

B

Bamboo•5/17/23, 5:33 AM

CREATE TABLE customers_data (
    customer_id INTEGER PRIMARY KEY AUTOINCREMENT,
    name TEXT,
    email TEXT,
    phone TEXT,
    gender TEXT CHECK(gender IN ('male', 'female'))
);

CREATE TABLE payments_data (
    customer_id INTEGER,
    transaction_date DATE,
    payment_mode TEXT CHECK(payment_mode IN ('online', 'offline')),
    payment_month DATE,
    FOREIGN KEY (customer_id) REFERENCES customers_data(customer_id)
);

CREATE TABLE customers_data (
    customer_id INTEGER PRIMARY KEY AUTOINCREMENT,
    name TEXT,
    email TEXT,
    phone TEXT,
    gender TEXT CHECK(gender IN ('male', 'female'))
);

CREATE TABLE payments_data (
    customer_id INTEGER,
    transaction_date DATE,
    payment_mode TEXT CHECK(payment_mode IN ('online', 'offline')),
    payment_month DATE,
    FOREIGN KEY (customer_id) REFERENCES customers_data(customer_id)
);

CREATE TABLE customers_data (
    customer_id INTEGER PRIMARY KEY AUTOINCREMENT,
    name TEXT,
    email TEXT,
    phone TEXT,
    gender TEXT CHECK(gender IN ('male', 'female'))
);

CREATE TABLE payments_data (
    customer_id INTEGER,
    transaction_date DATE,
    payment_mode TEXT CHECK(payment_mode IN ('online', 'offline')),
    payment_month DATE,
    FOREIGN KEY (customer_id) REFERENCES customers_data(customer_id)
);

CREATE TABLE customers_data (
    customer_id INTEGER PRIMARY KEY AUTOINCREMENT,
    name TEXT,
    email TEXT,
    phone TEXT,
    gender TEXT CHECK(gender IN ('male', 'female'))
);

CREATE TABLE payments_data (
    customer_id INTEGER,
    transaction_date DATE,
    payment_mode TEXT CHECK(payment_mode IN ('online', 'offline')),
    payment_month DATE,
    FOREIGN KEY (customer_id) REFERENCES customers_data(customer_id)
);

For using foreign key, is there anything extra I need to do, other than specifying it in schema when creating table?

Original message was deleted

M

Matt Silverlock•5/17/23, 10:11 AM

Sort of. Mongo’s driver is very heavy, and maintains cluster state on the client. It’s not really suitable for modern serverless environments at this point. This is why we recommend the Data API right now.

S

sandtrooper•5/17/23, 1:38 PM

what are the limits for D1 per worker invocation, if any.

here are the limits for KV,Cache,DO but it does not list D1 https://developers.cloudflare.com/workers/platform/limits/#kv-limits

Limits · Cloudflare Workers docs

You can request adjustments to limits that conflict with your project goals by contacting Cloudflare. To request an increase to a limit, complete the …

Ssandtrooper what are the limits for D1 per worker invocation, if any. here are the limits f...

U

Unsmart•5/17/23, 1:40 PM

https://developers.cloudflare.com/d1/platform/limits/

Limits · Cloudflare D1 docs

Many of these limits will increase during D1’s public alpha. Join the #d1-open-alpha channel in the Cloudflare Developer Discord to keep up to date …

S

sandtrooper•5/17/23, 1:41 PM

yes, but what about per CF worker invocation. are there any limits - like there is limits on number of KV calls etc

U

Unsmart•5/17/23, 1:42 PM

its the same as kv/cache/do

B

betim•5/17/23, 6:48 PM

B

betim•5/17/23, 6:49 PM

unlike previous version, I don't see the sqlite root cause nested in the Error structure

B

betim•5/17/23, 6:49 PM

is there a way to increase verbosity or anything?

M

Max (@rozenmd)•5/17/23, 7:05 PM

If you upgrade to wrangler v3, the local database will be in a different location

./.wrangler/state/v3/d1/<UUID>/db.sqlite

./.wrangler/state/v3/d1/<UUID>/db.sqlite

./.wrangler/state/v3/d1/<UUID>/db.sqlite

./.wrangler/state/v3/d1/<UUID>/db.sqlite instead of

./.wrangler/state/d1/DB.sqlite3

./.wrangler/state/d1/DB.sqlite3

./.wrangler/state/d1/DB.sqlite3

./.wrangler/state/d1/DB.sqlite3

I think it might be as simple as copying it over to the new location, but I haven't tried it myself.

Ttequila @betims @a11hard this might be the cause https://github.com/cloudflare/workers...

B

betim•5/17/23, 7:21 PM

thanks... that was it. after re-running the DB migrations, with a fresh D1 DB I was able to get things going again..

B

betim•5/17/23, 7:33 PM

I meant schema migrations, not data, ie.

wrangler d1 migration apply ...

wrangler d1 migration apply ...

wrangler d1 migration apply ...

wrangler d1 migration apply ...

Ttequila could you share the commands that you used? Maybe wrangler itself is capable of ...

M

Max (@rozenmd)•5/17/23, 7:55 PM

feel free to suggest it in #wrangler

Ttequila nope, I use `persist-to` with exactly the same location and it does not work

M

Max (@rozenmd)•5/17/23, 7:57 PM

note that the filename is different, you need to actually copy the file over and change the name

Yyamiteru I'm having the same issues

M

Max (@rozenmd)•5/17/23, 9:41 PM

does this help d1-database

CConfusedcius In the documentation, it says that backups are retained for 24 hours under the a...

M

Matt Silverlock•5/17/23, 11:39 PM

We only commit to storing backups for 24 hours right now, during the alpha. They may persist for longer, but (as an alpha product) it’s not final.

We’ll be moving away from full snapshots to something much better. Keep an eye on the blog on Friday

MMatt Silverlock We only commit to storing backups for 24 hours right now, during the alpha. They...

S

Sameer Ali•5/18/23, 3:10 AM

Can't wait for the Friday. Hopefully, we'll hear news about limit increase

DDavid (GMT-7)I'm using next.js on cloudflare pages and I'm able to connect a d1 database and ...

M

muslax•5/18/23, 6:51 AM

Hi, how and where do you setup the binding? Any example? Been struggling for weeks.

Ssourabh.sashank In wrangler .toml file. https://developers.cloudflare.com/d1/get-started/#4-bin...

M

muslax•5/18/23, 7:18 AM

But this is for workers, right? I read somewhere that Pages doesn’t support wrangler.toml.

M

muslax•5/18/23, 7:19 AM

I asked @asdf2 because he/she uses Nextjs, so I assume it’s Pages.

Mmuslax Hi, how and where do you setup the binding? Any example? Been struggling for wee...

M

Matt Silverlock•5/18/23, 9:46 AM

https://developers.cloudflare.com/d1/learning/using-d1-from-pages/

Bindings · Cloudflare Pages docs

A binding enables your Pages Functions to interact with resources on the Cloudflare developer platform. Use bindings to integrate your Pages Functions …

Ssourabh.sashank Can We directly insert JSON array of Objects as rows in batch to D1 ? If Yes, C...

M

Matt Silverlock•5/18/23, 10:26 AM

What have you tried? The draft documentation you linked is very close. Something like the below should work, depending on what you're trying to achieve:

INSERT INTO table(col1,col2)
SELECT key, value
FROM json_each('[55,66,77]')

INSERT INTO table(col1,col2)
SELECT key, value
FROM json_each('[55,66,77]')

INSERT INTO table(col1,col2)
SELECT key, value
FROM json_each('[55,66,77]')

INSERT INTO table(col1,col2)
SELECT key, value
FROM json_each('[55,66,77]')

… would attempt to insert the below values into col1,col2:

0,55
1,66
2,77

0,55
1,66
2,77

0,55
1,66
2,77

0,55
1,66
2,77

MMatt Silverlock https://developers.cloudflare.com/d1/learning/using-d1-from-pages/

M

muslax•5/18/23, 12:22 PM

Ty new doc.

Similar Threads

Similar Threads

Similar Threads