I have a pages app with functions in one dir, and workers in another -- how can I get them to share

I have a pages app with functions in one dir, and workers in another -- how can I get them to share the local d1 database?

RRyanD I have a pages app with functions in one dir, and workers in another -- how can ...

thiccvitalik•12/15/23, 7:49 PM

You can start the worker with 'npx wrangler dev --persist-to=../../.wrangler/state' and if you are using next-on-pages with dev bindings, it has also a persist option which takes a path.

Tthiccvitalik You can start the worker with 'npx wrangler dev --persist-to=../../.wrangler/sta...

RyanDOP•12/15/23, 7:51 PM

I've been trying but it seems they both create different sql files, the paths are right but I end up with different database files

RRyanD I've been trying but it seems they both create different sql files, the paths ar...

thiccvitalik•12/15/23, 8:58 PM

This is the section in my worker's wrangler.toml:
[[d1_databases]]
binding = "DB" # Should match preview_database_id
database_name = "dev-db"
database_id = "the-id-of-your-D1-database-goes-here"
preview_database_id = "DB" # Required for Pages local development
migrations_dir = "../../db/migrations"

And my next.conf:
setupDevBindings({ d1Databases: ['DB'], persist: '../.wrangler/state/v3' });

Hope it helps

jayMakes11•12/15/23, 9:06 PM

Is d1 (or sqlite in general) a good fit for a spread-sheet type of application (where users can create new columns and rename and reorder them on-the-fly)?

jayMakes11•12/15/23, 9:07 PM

(can't get my head around dynamic column creation in the context of the need for a db schema)

RRyanD I've been trying but it seems they both create different sql files, the paths ar...

Max (@rozenmd)•12/15/23, 10:31 PM

I was working on fixing this just today, it's not great

Max (@rozenmd)•12/15/23, 10:31 PM

you basically have to run wrangler pages dev ... --d1=DBwrangler pages dev ... --d1=DB and set preview_database_id="DB"preview_database_id="DB" in your wrangler.toml so that the

wrangler d1

wrangler d1

commands use the same database locally

Isak•12/16/23, 1:12 AM

Hi @Matt just checking in again on issue. Everything seems to work now and the error is gone. Was there any outage or what was the problem?

Gagan Suie•12/16/23, 1:43 AM

Considering replacing mongoDB with D1 or Postgres.

Could yall weigh in on the response by Guillermo.

https://twitter.com/GaganSuie/status/1735829041049956453?t=ZUc7UWrcEl9_SwhTQnInEQ&s=19

kian•12/16/23, 1:49 AM

Comparing the TTFB of SSR to a website that doesn't work without JS is... interesting?

kian•12/16/23, 1:51 AM

Like, he is running the test against the wrong page.

kian•12/16/23, 1:51 AM

kian•12/16/23, 1:51 AM

Kkian Like, he is running the test against the wrong page.

Gagan Suie•12/16/23, 1:55 AM

Interesting. I appreciate the clarification.

kian•12/16/23, 1:59 AM

I don't think either of these actually compare the DB either - this is just the TTFB of the HTML & JS that'll later query the DB.

GGagan Suie 🤔 Interesting. I appreciate the clarification.

Max (@rozenmd)•12/16/23, 7:47 AM

D1 is entirely performance unoptimised, too. We just changed approach from alpha to beta and that happened to speed things up, but we don't have replication yet.

cystemz•12/16/23, 8:13 AM

Why do i have to build my sveltekit project in order to have d1 support for local development

cystemz•12/16/23, 8:14 AM

this makes it 10x slower to actively develop as i cant hot reload and have to build the project each time

Ccystemz this makes it 10x slower to actively develop as i cant hot reload and have to bu...

Isak•12/16/23, 12:14 PM

You can bind local MiniFlare during dev see here https://github.com/cloudflare/miniflare/pull/639#issuecomment-1650956916

GitHub

[Miniflare 3] ✨ Implement *magic* proxy and add back support for `M...

Hey!

This PR adds back support for Miniflare 2's Miniflare#get*() methods for accessing bindings from outside the Workers sandbox. It does this by implementing a proxy system, that makes HTTP...

MMax (@rozenmd)you basically have to run `wrangler pages dev ... --d1=DB` and set `preview_dat...

RyanDOP•12/16/23, 2:27 PM

Thanks, that worked! For search history I also added --persist-to=./db to the wrangler dev for the worker and the pages command so it was easier to point them both to the same state dir

Sia•12/16/23, 3:06 PM

Hey, what is the price of D1? I can't find it on the website?

What are the limits?

Cyb3r-Jak3•12/16/23, 3:09 PM

Pricing: https://developers.cloudflare.com/d1/platform/pricing/ and Limits: https://developers.cloudflare.com/d1/platform/limits/
Still public beta so free for now and limits will increase

divby0•12/16/23, 3:34 PM

I have one database on a production project that is still the "old" version where you had backups instead of this point-in-time recovery. This old database version does work, but I guess I should upgrade it for better performance and future updates.

Now, last time I tried, I got hit by a 20 query-depth something limit that made me spent 2 days without any result, so I had to roll back and forget about it.

Now that this got increased, what are some other points where I could potentially be negatively surprised? Are there any other things that work better on the old version?

Ddivby0 I have one database on a production project that is still the "old" version wher...

Matt Silverlock•12/16/23, 7:56 PM

We will eventually deprecate that backend: there should be almost no limits that are higher there, and beyond that, the old backend was just unreliable. All the query depth in the world doesn’t matter if you can’t query a database reliably after it grows beyond 50MB.

IIsak You can bind local MiniFlare during dev see here https://github.com/cloudflare/m...

Cy•12/16/23, 9:43 PM

Thank you. I’ll look into the documentation soon

Denver James Duran•12/16/23, 10:18 PM

Hi! So I was able to make a fully working version locally thanks to you guys however, when deployed, I'm wondering cause some of the WRITE (insert) requests do not register, and I wanna know why.. It doesn't give me any error messages as well.. and it does it randomly any idea why?

MMatt Silverlock We will eventually deprecate that backend: there should be almost no limits that...

divby0•12/16/23, 10:22 PM

Sure, I get your point and I agree that this is the way to go for cloudflare (prioritizing reliability over stuff like query depth). Still, it's a direct dealbreaker if most of my queries that are used in my backend simply won't work. But now that this has been increased, I guess I'll try again to migrate soon

DDenver James Duran Hi! So I was able to make a fully working version locally thanks to you guys how...

kian•12/16/23, 10:22 PM

We'd need more information - what's your code, what do you mean by not registering (writing in a deployed Worker isn't adding rows?), etc

Denver James Duran•12/16/23, 10:37 PM

my messages wont go through here I think discord is having a problem

Denver James Duran•12/16/23, 10:37 PM

Here's the deployed website: https://cafezinho.denvie.online/
I'm using sveltekit.

Basically, the user orders thru the website. The website then sends a formData to one of my API servers.
my server, runs an insert statement then returns order created when there's no error in inserting the data. I also used ZOD validation...

here's the server code:

Kkian We'd need more information - what's your code, what do you mean by not registeri...

Denver James Duran•12/16/23, 10:39 PM

Ahh sorry but discord wont allow me to send code here.. I'll send screenshots if it's okay

Denver James Duran•12/16/23, 10:39 PM

DDenver James Duran Ahh sorry but discord wont allow me to send code here.. I'll send screenshots if...

thiccvitalik•12/16/23, 10:41 PM

You are missing an 'await' for the query

Denver James Duran•12/16/23, 10:42 PM

I tried to follow this: https://developers.cloudflare.com/d1/platform/client-api/

got it, where do I put it, before platform?

Tthiccvitalik You are missing an 'await' for the query

Denver James Duran•12/16/23, 10:42 PM

Thank you .. I didn't realize I needed it cause it works sometimes.. Im gonna try it

Tthiccvitalik You are missing an 'await' for the query

Denver James Duran•12/16/23, 10:47 PM

Thanks so much @thiccvitalik I think it works fine now. I was so silly not adding it.

Ddivby0 Sure, I get your point and I agree that this is the way to go for cloudflare (pr...

Matt Silverlock•12/16/23, 10:53 PM

If you have specific queries that don’t run on the production backend, open a GitHub issue.

Isaac McFadyen•12/16/23, 11:03 PM

Tip for the future: there should almost never be a reason to cast into unknownunknown and then another type. If it won't cast without the unknown then it's likely something else is wrong.

IIsaac McFadyen Tip for the future: there should almost never be a reason to cast into `unknown`...

Denver James Duran•12/16/23, 11:19 PM

uhm, can you help me overcome it? cause I followed the set up but on my app.d.ts, the D1Database isn't defined... so my platform.env.database.prepare.bind.run() is always unknown

kian•12/16/23, 11:30 PM

run

run

shouldn't actually return anything (https://developers.cloudflare.com/d1/platform/client-api/#await-stmtrun) but iirc it's broken and does.

kian•12/16/23, 11:30 PM

kian•12/16/23, 11:31 PM

Yeah - I have no idea when it stopped returning errors like D1_ERROR: Error: SQL execute error: Execute returned results - did you mean to call query?D1_ERROR: Error: SQL execute error: Execute returned results - did you mean to call query? but it's probably going to be a pain to return to it's original behaviour without breaking projects

kian•12/16/23, 11:32 PM

Valve pls fix rapidfire

kian•12/16/23, 11:32 PM

nvm they did

Original message was deleted

Denver James Duran•12/16/23, 11:38 PM

Thanks!

Kkian `run` shouldn't actually return anything (<https://developers.cloudflare.com/d1/...

Denver James Duran•12/16/23, 11:39 PM

it says it returns the metrics only

Original message was deleted

Denver James Duran•12/16/23, 11:42 PM