Cloudflare Developers•2y ago

I think hyperdrive uses smart routing/argo?

ChaikaOP•7/31/24, 4:22 PM

well if it's already resolved safe bet it was that, since they said fix implemented/just started recently

CChaika I think hyperdrive uses smart routing/argo?

Ping for toast•7/31/24, 4:23 PM

yeah, back to expectedly (high) latencies 5 minutes or so ago

Ping for toast•7/31/24, 4:24 PM

returned to normal at 12:19

Original message was deleted

Ping for toast•7/31/24, 4:26 PM

man im honestly surprised how quiet all this was

Ping for toast•7/31/24, 4:26 PM

is everything really virginia

Jonathan Silva•7/31/24, 9:13 PM

Generates error when creating a Worker via API

Error
"Uncaught SyntaxError: Unexpected token 'export'\n at worker.js:141\n"

New code:

export default {
    async fetch(request, env, ctx) {
        const url = new URL(request.url);

        if (url.pathname === ENDPOINT) {
            handle(request, url);
        }
    }
}

export default {
    async fetch(request, env, ctx) {
        const url = new URL(request.url);

        if (url.pathname === ENDPOINT) {
            handle(request, url);
        }
    }
}

It worked with:

addEventListener("fetch", event => {
    const url = new URL(event.request.url);

    if (url.pathname === ENDPOINT) {
        event.respondWith(handle(event, url));
    }
});

addEventListener("fetch", event => {
    const url = new URL(event.request.url);

    if (url.pathname === ENDPOINT) {
        event.respondWith(handle(event, url));
    }
});

Jonathan Silva•7/31/24, 9:43 PM

I create the Worker with this endpoint

Jonathan Silva•7/31/24, 9:43 PM

https://developers.cloudflare.com/api/operations/worker-script-upload-worker-module

kian•7/31/24, 11:14 PM

kian•7/31/24, 11:14 PM

You need to use form-data to use Module Workers

kian•7/31/24, 11:14 PM

Jonathan Silva•7/31/24, 11:44 PM

Thanks, I'll try here
I will have to redo the entire request

Ping for toast•8/1/24, 2:18 AM

For cloudflare verified bots, is there a way that a request coming from a cloudflare worker can be verified as obviously I do not own the IP?

Ping for toast•8/1/24, 2:19 AM

if not I could look into making these requests from a VPS with a fixed IP instead

Ping for toast•8/1/24, 2:25 AM

oh I might not be eligible at this scale

Lastly, if you work at a startup, your company may run automated services that haven’t reached the scale we require. But you still need a way to allowlist these services.

I crawl sites to generate page previews in response to user action, and I've been getting a lot of titles back as "Just a moment..."

Ping for toast•8/1/24, 2:27 AM

oh that makes me think... something cloudflare could do is expose opengraph metadata on pages to bot operators, because thats all I need and also it exists specifically for bots

rbravo•8/1/24, 3:23 AM

Can I have multiple consumers in one Worker, each one processing different queues?

Context:

I'm reading this in the docs:

Best practice
Configure a single consumer per queue. This both logically separates your queues, and ensures that errors (failures) in processing messages from one queue do not impact your other queues.

Rrbravo Can I have multiple consumers in one Worker, each one processing different queue...

Ping for toast•8/1/24, 5:30 AM

It is my understanding that you can have a single worker reading ("consuming") multiple queues, but a single queue should only be read by one worker

Ping for toast•8/1/24, 5:33 AM

Avi•8/1/24, 9:06 AM

is there truly no way to read environment variables when my worker starts up? (i.e. before the initial fetch() comes in?)

Avi•8/1/24, 9:06 AM

would be fine with this even being limited to local dev...

Baby Beel•8/1/24, 9:58 AM

isn't scrypt in worker?

dom•8/1/24, 1:13 PM

might be a dumb question but which permissions should i use if i want to create an API token to update cron triggers for a worker? it doesn't seem like there's a separate scope for it

Ddom might be a dumb question but which permissions should i use if i want to create ...

Isaac McFadyen•8/1/24, 1:26 PM

I believe it should fall under Edit Worker permissions.

infinite cat gen•8/1/24, 5:14 PM

Hey, quick question

infinite cat gen•8/1/24, 5:15 PM

is it possible to open a worker to direct IP connections?

Iinfinite cat gen is it possible to open a worker to direct IP connections?

ChaikaOP•8/1/24, 5:16 PM

You mean tcp/udp inbound, essentially? As it is right now workers fit firmly behind the CDN/normal proxy. They've talked about being able to have tcp/udp inbound in the past, but nothing yet

CChaika You mean tcp/udp inbound, essentially? As it is right now workers fit firmly beh...

infinite cat gen•8/1/24, 5:16 PM

I need to handle a few POST and GET requests

infinite cat gen•8/1/24, 5:16 PM

I can't change something in my programs code so I wrote an API that handles that for me

ChaikaOP•8/1/24, 5:17 PM

If you mean just skipping the cdn or something then as said above they sit firmly behind the cdn/normal proxy. Workers do not have IPs assigned to them. They run everywhere on every machine

CChaika If you mean just skipping the cdn or something then as said above they sit firml...

infinite cat gen•8/1/24, 5:17 PM

ah alright

Iinfinite cat gen I need to handle a few POST and GET requests

ChaikaOP•8/1/24, 5:17 PM

Workers can handle that

ChaikaOP•8/1/24, 5:17 PM

unless you're talking about getting around the upload limit or something

CChaika unless you're talking about getting around the upload limit or something

infinite cat gen•8/1/24, 5:18 PM

No I don't need to get around that

infinite cat gen•8/1/24, 5:19 PM

I need to modify my hosts file to include the IP of the worker, because the hosts file can't handle URL to URL redirects

infinite cat gen•8/1/24, 5:19 PM

That's why I'm asking

Iinfinite cat gen I need to modify my hosts file to include the IP of the worker, because the host...

ChaikaOP•8/1/24, 5:22 PM

yea I mean they're behind the normal cdn so you would have to pass the right host header/sni/url to reach them, and even then CDN IPs are not a good idea to hardcode as they change

infinite cat gen•8/1/24, 5:22 PM

yeah so no point in trying

infinite cat gen•8/1/24, 5:22 PM

thx for help

ChaikaOP•8/1/24, 5:22 PM

could maybe use some other proxy server (like nginx on a vps) to proxy the requests to workers but that'd be another step

CChaika could maybe use some other proxy server (like nginx on a vps) to proxy the reque...

infinite cat gen•8/1/24, 5:23 PM

maybe ill be able to do that

infinite cat gen•8/1/24, 5:23 PM

lemme see

infinite cat gen•8/1/24, 5:26 PM

nah i think ill just try something different

Jonathan Silva•8/1/24, 6:10 PM

Good afternoon
How to resolve this error in request.json() ?

JJonathan Silva Good afternoon How to resolve this error in request.json() ?

Idle•8/1/24, 6:11 PM

most likely by catching it or making sure that the request body has a valid json format?

Frank•8/1/24, 9:49 PM

is there a limit on how many custom cache namespace we can create?

Hyper•8/1/24, 10:14 PM

Hey guys. I want to create a notification system but im not sure where to start. my original idea was using durable objects but i think the limit of 32,000 active connections makes it not scalable, and if i go for a 1:1 architcture then it would be difficult to communicate with other DOs. My next idea is SSE using the event source API. What I want to achieve is essentially when a request is made to my API (which runs on workers), some requests will trigger notifications to reach certain clients. Id like to communicate the data to those specific clients. Any ideas or suggestions?

For example, user A sends a friend request to user B by calling an API endpoint on my worker. I want to push the notification to user B. Any help would be appreciated

Brett Willis•8/2/24, 12:25 AM

Coming from Node.JS, the event loop is well understood. Particularly that Promise callbacks operate on the microtask queue and I/O is not processed in between microtasks. Unless I've missed something in my searches, very little is described about the event loop in Workers and how/when the event loop processes other requests (does it use the "default" V8 event loop implementation, and how does that work?).

The reason I ask is is: how to break up long-running CPU-intensive calculations to allow other requests to be processed in between? E.g. calculating password hashes using noble-hashesnoble-hashes. That library provides an async implementation which just uses promise callbacks (microtask queue) to break up the calculation: https://github.com/paulmillr/noble-hashes/blob/ae060daa6252f3ff2aa2f84e887de0aab491281d/src/utils.ts#L103-L119.

If the workers event loop is similar to Node.JS, I/O and other requests will not be processed between microtasks. So the async implementation would only be less efficient and not have the desired effect of breaking up yielding the CPU to other requests.

Can someone teach me how the Workers event loop is implemented and how to yield to other requests?

BBrett Willis Coming from Node.JS, the event loop is well understood. Particularly that Promis...

kian•8/2/24, 12:41 AM

The first part about microtask queues blocking I/O sounds like the same scenario as described in https://github.com/cloudflare/workerd/blob/ce15e0b82e6408c49ec3e980f23640bd25d6c675/src/workerd/io/io-context.c%2B%2B#L1044-L1065. Unfortunately, looking at the runtime is probably the only 'documentation' about details like this at the moment.

Kkian The first part about microtask queues blocking I/O sounds like the same scenario...

Brett Willis•8/2/24, 1:10 AM

Thanks for pointing me to that code! I won't pretend to understand the code but yeah from reading that comment it seems to suggest that it behaves the same as Node.JS in that microtasks callbacks do not yield to process I/O (and I'm assuming that "I/O" includes other requests).
No benefit to using the async noble-hashesnoble-hashes versions then, just the significant overhead of enqueueing/dequeueing the stack onto the microtask queue.
It seems you also answered the other question: it looks like Workers has it's own event loop implementation.

I think hyperdrive uses smart routing/argo?

Similar Threads

Similar Threads

Similar Threads