workerd seems to be the main way to run workers locally now, but it doesn't offer the same controls

SSamy workerd seems to be the main way to run workers locally now, but it doesn't offe...

H

There are three systems for developing/testing Workers locally:
workerd - the Workers Runtime
miniflare - provides Mocks and Compat stuff
wrangler - CLI and pixelcf

API interface.
All of these parts interoperate to produce a local development/testing environment
With the release of wrangler 3, everything should run through wrangler, rather than Miniflare directly.

S

SamyOP•6/1/23, 12:42 PM

Yes I'm getting that, but in my case it's more about the unit tests case, so using the JS API of Miniflare to run it and call different functions on it to inspect its state.
When running the worker for development, we use wrangler.

SSamy Yes I'm getting that, but in my case it's more about the unit tests case, so usi...

D

DaniFoldi•6/1/23, 12:56 PM

for the time being, i'd stick to your current setup (which I'm assuming is

vitest-environment-miniflare

vitest-environment-miniflare

vitest-environment-miniflare

vitest-environment-miniflare, or maybe

jest-environment-miniflare

jest-environment-miniflare

jest-environment-miniflare

jest-environment-miniflare), and there should be a new variant that supports v3 soontm

S

sathoro•6/1/23, 5:45 PM

CacheError [ERR_DESERIALIZATION]: Unable to deserialize stored cached data due to missing metadata.
The cached data storage format changed in Miniflare 2. You cannot load cached data created with Miniflare 1 and must delete it.

CacheError [ERR_DESERIALIZATION]: Unable to deserialize stored cached data due to missing metadata.
The cached data storage format changed in Miniflare 2. You cannot load cached data created with Miniflare 1 and must delete it.

CacheError [ERR_DESERIALIZATION]: Unable to deserialize stored cached data due to missing metadata.
The cached data storage format changed in Miniflare 2. You cannot load cached data created with Miniflare 1 and must delete it.

CacheError [ERR_DESERIALIZATION]: Unable to deserialize stored cached data due to missing metadata.
The cached data storage format changed in Miniflare 2. You cannot load cached data created with Miniflare 1 and must delete it.

this just randomly happened for data that was just cached minutes before

E

Elliot Hesp•6/2/23, 10:48 AM

Is there anyway to view KV records in a UI like the cloudflare dashboard?

EElliot Hesp Is there anyway to view KV records in a UI like the cloudflare dashboard?

M

MrBBot•6/5/23, 11:25 AM

Not yet, but it is something I'd like to see us add. Probably going to explore IDE extensions for editting this data first though.

Sstevefrench is it possible to test workers with wrangler?

D

DaniFoldi•6/8/23, 2:20 PM

I'd stick to your current

vitest-environment-miniflare

vitest-environment-miniflare

vitest-environment-miniflare

vitest-environment-miniflare setup until v3 supports it in some way - unit tests aren't currently possible - you can use

unstable_dev

unstable_dev

from wrangler if you want to do e2e

EEduardo are there any docs for v3? The current docs seems to be partially v2 and partial...

D

DaniFoldi•6/8/23, 9:51 PM

Currently, v3 is only meant to be used through wrangler dev, or unstable_dev - hopefully we’ll see updates to the vitest environment once all the blockers are resolved there. The team also mentioned IDE integrations so you can view/interact with the local bindings directly

Y

yeehow•6/11/23, 9:18 PM

Any idea for when there will be analytics engine support with miniflare?

A

Adi•6/14/23, 2:02 AM

Hey guys, came here from the d1 channel.

I've been curious about this since miniflare 3 came out.
With those old miniflare 2 packages (https://www.npmjs.com/package/@miniflare/d1) when in a test environment, you could write code that would simulate d1 in the following way

import { D1Database, D1DatabaseAPI } from "@miniflare/d1";
import { drizzle } from "drizzle-orm/d1";

const d1 = new D1Database(new D1DatabaseAPI(sqliteDb));
const db = drizzle(d1); // now I can can write unit tests for drizzle

import { D1Database, D1DatabaseAPI } from "@miniflare/d1";
import { drizzle } from "drizzle-orm/d1";

const d1 = new D1Database(new D1DatabaseAPI(sqliteDb));
const db = drizzle(d1); // now I can can write unit tests for drizzle

import { D1Database, D1DatabaseAPI } from "@miniflare/d1";
import { drizzle } from "drizzle-orm/d1";

const d1 = new D1Database(new D1DatabaseAPI(sqliteDb));
const db = drizzle(d1); // now I can can write unit tests for drizzle

import { D1Database, D1DatabaseAPI } from "@miniflare/d1";
import { drizzle } from "drizzle-orm/d1";

const d1 = new D1Database(new D1DatabaseAPI(sqliteDb));
const db = drizzle(d1); // now I can can write unit tests for drizzle

How can I write this with miniflare 3?

AAdi Hey guys, came here from the d1 channel. I've been curious about this since min...

M

MrBBot•6/14/23, 9:37 AM

Hey!

Great question! Miniflare 3 only provides an implementation of the internal D1 API. Wrangler injects "shim" code into your worker to wrap this API into the regular D1 database API. There's an in-progress PR to move this "shim" out of Wrangler and into the runtime (https://github.com/cloudflare/workerd/pull/764), where it would be accessible to Miniflare. For now, your best bet is probably to just stay on Miniflare 2 until that PR is merged and a new version of

workerd

workerd

workerd

workerd is released.

MMrBBot Hey! 👋 Great question! Miniflare 3 only provides an implementation of the inter...

A

Adi•6/14/23, 9:44 AM

Ahh ok, that makes sense. Thanks

H

Hasi•6/17/23, 12:38 PM

Ummm

H

Hasi•6/17/23, 12:38 PM

/usr/lib/node_modules/wrangler/node_modules/@cloudflare/workerd-linux-64/bin/workerd: error while loading shared libraries: libc++.so.1: cannot open shared object file: No such file or directory
✘ [ERROR] MiniflareCoreError [ERR_RUNTIME_FAILURE]: The Workers runtime failed to start. There is likely additional logging output above.

/usr/lib/node_modules/wrangler/node_modules/@cloudflare/workerd-linux-64/bin/workerd: error while loading shared libraries: libc++.so.1: cannot open shared object file: No such file or directory
✘ [ERROR] MiniflareCoreError [ERR_RUNTIME_FAILURE]: The Workers runtime failed to start. There is likely additional logging output above.

/usr/lib/node_modules/wrangler/node_modules/@cloudflare/workerd-linux-64/bin/workerd: error while loading shared libraries: libc++.so.1: cannot open shared object file: No such file or directory
✘ [ERROR] MiniflareCoreError [ERR_RUNTIME_FAILURE]: The Workers runtime failed to start. There is likely additional logging output above.

/usr/lib/node_modules/wrangler/node_modules/@cloudflare/workerd-linux-64/bin/workerd: error while loading shared libraries: libc++.so.1: cannot open shared object file: No such file or directory
✘ [ERROR] MiniflareCoreError [ERR_RUNTIME_FAILURE]: The Workers runtime failed to start. There is likely additional logging output above.

H

Hasi•6/17/23, 12:40 PM

Which package should I install?

H

Hasi•6/17/23, 12:41 PM

mmhm I think I've found it xD

H

Hasi•6/17/23, 12:45 PM

/usr/lib/node_modules/wrangler/node_modules/@cloudflare/workerd-linux-64/bin/workerd: error while loading shared libraries: libunwind.so.1: cannot open shared object file: No such file or directory

/usr/lib/node_modules/wrangler/node_modules/@cloudflare/workerd-linux-64/bin/workerd: error while loading shared libraries: libunwind.so.1: cannot open shared object file: No such file or directory

/usr/lib/node_modules/wrangler/node_modules/@cloudflare/workerd-linux-64/bin/workerd: error while loading shared libraries: libunwind.so.1: cannot open shared object file: No such file or directory

/usr/lib/node_modules/wrangler/node_modules/@cloudflare/workerd-linux-64/bin/workerd: error while loading shared libraries: libunwind.so.1: cannot open shared object file: No such file or directory

H

Hasi•6/17/23, 12:45 PM

And I have the lib installed

D

DaniFoldi•6/17/23, 12:47 PM

what distro & version is that? linux support is a little rough today, debian 12 and ubuntu 22.04 are the only ones I know workerd supports - they are working on improving this though, so soontm

things will be a lot smoother

DDaniFoldi what distro & version is that? linux support is a little rough today, debian 12 ...

H

Hasi•6/17/23, 12:47 PM

Btw I use

H

Hasi•6/17/23, 12:48 PM

so it doesn't support arch?

D

DaniFoldi•6/17/23, 12:49 PM

I don't know the answer to that, unfortunately - it might support it somehow but it's the weekend so I don't want to ping people on the team, I'll try to get back to you on Monday though!

DDaniFoldi I don't know the answer to that, unfortunately - it might support it _somehow_ b...

H

Hasi•6/17/23, 12:50 PM

if it doesn't support arch it doesn't exists.

H

Hasi•6/17/23, 12:52 PM

anyways, so i stick to --remote for now

V

vvo•6/27/23, 1:46 PM

Hey there, I found a behavior difference between miniflare (via wrangler latest version) and a deployed worker: when using

env.R2_BUCKET.put(key, request.body)

env.R2_BUCKET.put(key, request.body)

env.R2_BUCKET.put(key, request.body)

env.R2_BUCKET.put(key, request.body) you will get an error like "Provided readable stream must have a known length (request/response body or readable half of FixedLengthStream)".

1. It's working when deployed on Cloudflare workers
2. It's a request.body

T

TravisFrank•6/29/23, 4:39 PM

Are the v3 API options documented anywhere?

M

MrBBot•6/29/23, 5:27 PM

Miniflare 3 API docs: https://github.com/cloudflare/miniflare/blob/tre/packages/miniflare/README.md

MMrBBot 📚 Miniflare 3 API docs: https://github.com/cloudflare/miniflare/blob/tre/packa...

T

TravisFrank•6/29/23, 6:12 PM

Thanks @mrbbot!

T

TravisFrank•6/29/23, 10:11 PM

Any chance

sourcemap

sourcemap

sourcemap

sourcemap support is on the docket for the API? That's pretty much the only bit of moving to v3 that's got me bummed, the logging leaves a lot to be desired

TTravisFrank Any chance `sourcemap` support is on the docket for the API? That's pretty much...

M

MrBBot•6/29/23, 10:40 PM

Source mapping should be supported by default, but due to a bug in

workerd

workerd

workerd

workerd, you'll need to wrap your worker with something that returns un-source-mapped stack traces as JSON using the

MF-Experimental-Error-Stack

MF-Experimental-Error-Stack

MF-Experimental-Error-Stack

MF-Experimental-Error-Stack header: https://github.com/cloudflare/workers-sdk/blob/main/packages/wrangler/templates/middleware/middleware-miniflare3-json-error.ts. Wrangler will do this automatically.

As for logging, completely agree. I'd like to try bring Node's log formatting to

workerd

workerd

workerd

workerd at some point.

T

TravisFrank•6/29/23, 10:47 PM

Sweet, thanks for the tip

T

TravisFrank•6/29/23, 10:50 PM

Overall the upgrade feels good, it's like a warm safety blanket knowing the runtime is the same. I also actually find myself enjoying doing away with the

wrangler.toml

wrangler.toml

parsing and passing bindings in the config- it's less "magic", but for me it seems easier to debug

TTravisFrank Overall the upgrade feels good, it's like a warm safety blanket knowing the runt...

M

MrBBot•6/29/23, 10:53 PM

Nice, glad you're liking it! We're planning to standardise/simplify the

unstable_dev()

unstable_dev()

unstable_dev()

unstable_dev() API (https://developers.cloudflare.com/workers/wrangler/api/) at some point soon, which will allow you to use your

wrangler.toml

wrangler.toml

file, but customise as required in JavaScript too.

T

TravisFrank•6/29/23, 10:55 PM

Yes, love that!

T

TravisFrank•6/29/23, 10:56 PM

Btw, in case I'm missing something- there's no way to run multiple workers with

wrangler dev

wrangler dev

, right? If there is I can save myself the pain of manually putting together the

esbuild

esbuild

esbuild

esbuild watch -> MF reload script.

M

MrBBot•6/29/23, 10:58 PM

Yes there is, right now if you run a

wrangler dev

wrangler dev

session in each worker's directory, they should auto-magically connect. We're considering eventually moving to a Docker Compose style solution, where running

wrangler dev

wrangler dev

automatically starts up all required services though.

T

TravisFrank•6/29/23, 11:09 PM

Oh wow

T

TravisFrank•6/29/23, 11:25 PM

T

TravisFrank•6/29/23, 11:27 PM

It doesn't look like service bindings are working for me. I also don't get any sort of "Your worker has access to the following bindings: - Services:"

TTravisFrank It doesn't look like service bindings are working for me. I also don't get any ...

M

MrBBot•6/29/23, 11:31 PM

Hmmm ok, could you try restart your computer and then try again? This is kinda why I'd like to see us move to a Docker Compose like thing, sometimes this magic doesn't work.

T

TravisFrank•6/29/23, 11:41 PM

Damn, still no luck :/

T

TravisFrank•6/29/23, 11:42 PM

Where does the service registry live on my machine?

workerd seems to be the main way to run workers locally now, but it doesn't offer the same controls

Similar Threads

Similar Threads

Similar Threads