Cloudflare Developers•2y ago

oh cpu time is quite different from actual time right?

JoeDoeOP•2/29/24, 11:00 AM

I need my worker to get some data, but the initial 'sync' might take like 10mins+

JJoeDoe oh cpu time is quite different from actual time right?

Hello, I’m Allie!•2/29/24, 11:02 AM

CPU time is time that your Worker is actually doing something. For example, streaming a request to your origin is not counted as CPU Time, but hashing the request body is

JoeDoeOP•2/29/24, 11:03 AM

perfect should be fine then

JJoeDoe perfect should be fine then

Hello, I’m Allie!•2/29/24, 11:04 AM

Though note that 10 minutes might be stretching the limits there. I wouldn’t say it won’t ever work, but I would be wary of expecting it to work every time

vakno•2/29/24, 11:09 AM

I have a parent worker that has service bindings with two child workers that change HTML responses using HTMLRewriter. I want changes that these 2 workers make all applied to the trigger url of parent worker. I cant seem to figure out how to combine responses.
Any help would be appreciated.

HHello, I’m Allie!Are you doing this locally, or deployed?

Old Man Maker•2/29/24, 11:35 AM

@HardlyWorkin' - it's deployed

Old Man Maker•2/29/24, 11:39 AM

Matt just spotted I was missing an await call... FFS. Need a sleep. Thanks for chiming in @HardlyWorkin'

Santosh•2/29/24, 3:11 PM

I am planning to process File uploads with some more parameters using Form Data. Whats the latest status of using form data in workers? I have seen many posts from 2022ish time frame, nothing recent yet. Can someone pl point me to a sample that I can leverage as guidance on how to process form data with Workers/Page functions? I believe this is one of the last posts: https://community.cloudflare.com/t/accessing-a-formdata-object-in-a-cloudflare-workers-function/287517/3

kian•2/29/24, 3:21 PM

Everything on https://developer.mozilla.org/en-US/docs/Web/API/FormData should be accurate.

kian•2/29/24, 3:21 PM

Just use a modern compatibility date and FileFile objects will work fine.

Santosh•2/29/24, 3:22 PM

This article does talk about formdata now being available. If you could pl confirm if this sample should work as is? (I can use R2 instead of B2 of course): https://walshy.dev/blog/21_09_10-handling-file-uploads-with-cloudflare-workers

Handling File Uploads with Cloudflare Workers

This is a tutorial of using the File API to handle file uploads on Cloudflare Workers

kian•2/29/24, 3:23 PM

Yes, FormData will work as you expect.

Dragon•2/29/24, 5:06 PM

Hi Team,
I am building a backend service using itty-router cloudflare and deployed it over the worker. but it is giving cors error when calling from React application. your help will be highly appriciated.

kian•2/29/24, 5:08 PM

Have you taken a look at https://itty.dev/itty-router/cors?

Dragon•2/29/24, 5:41 PM

I did, but let me give it a shot again

Dragon•2/29/24, 5:43 PM

that you!

Dragon•2/29/24, 6:12 PM

I am using this module @cloudflare/itty-router-openapi

Dragon•2/29/24, 6:13 PM

And this code doesn't work with above module

Dragon•2/29/24, 6:13 PM

router
.handle(request, ...args)

// turn any returned raw data into JSON
.then(json)

// catch errors BEFORE corsify
.catch(error)

// corsify all Responses (including errors)
.then(corsify)

Dragon•2/29/24, 6:26 PM

Shall I use plain itty-router instead of "@cloudflare/itty-router-openapi"?

Dragon•2/29/24, 6:26 PM

what do you suggest here?

Rasel Rana Rocky•3/1/24, 6:01 AM

vitestvitest doesn't seem to work with @cloudflare/itty-router-openapi@cloudflare/itty-router-openapi, there's a require()require() call in the

.mjs

.mjs

for js-yamljs-yaml.

quisi.do•3/1/24, 6:27 AM

There are so many ways to read and write data: D1, R2, Analytics engine, KV, logpushd, more?
If I wanted to read and write a counter on every request, what's the best way to do that? E.g. x = x+1.
I'm considering using queues to stack the increments up and bulk process them, which would save a lot on write costs, but I still don't know where to read/write. Or if there's a better way.

Qquisi.do There are so many ways to read and write data: D1, R2, Analytics engine, KV, log...

Hello, I’m Allie!•3/1/24, 6:29 AM

If you just want to be able to increment a counter, I would probably go with Analytics Engine

Original message was deleted

Hello, I’m Allie!•3/1/24, 6:30 AM

Well, if they are just incrementing, then they don’t actually need to read, just write

Hello, I’m Allie!•3/1/24, 6:30 AM

Write a row, then count

Original message was deleted

quisi.do•3/1/24, 6:31 AM

What's the scale issue I'd face with D1? Like a latency issue?

Original message was deleted

Hello, I’m Allie!•3/1/24, 6:31 AM

Yes, but then they gave the example of incrementing a counter

HHello, I’m Allie!Well, if they are just incrementing, then they don’t actually *need* to read, ju...

quisi.do•3/1/24, 6:32 AM

I do need to read. In each request, I'm essentially checking if the value has reached a certain number. It doesn't need to be strictly consistent so I can wait for the bulk process and be off by a few.

Qquisi.do I do need to read. In each request, I'm essentially checking if the value has re...

Hello, I’m Allie!•3/1/24, 6:34 AM

So it is an increment, plus a read? What you could do is push to AE, then have a cron trigger that checks whether it went over, and pushes that state to KV

Hello, I’m Allie!•3/1/24, 6:34 AM

This has the added benefit of being comparatively scalable

Hello, I’m Allie!•3/1/24, 6:34 AM

Since you aren’t hammering the data store on every request

Original message was deleted

quisi.do•3/1/24, 6:36 AM

Hmm. I don't see it in the limits docs but I hadn't considered throttle limits.

Qquisi.do Hmm. I don't see it in the limits docs but I hadn't considered throttle limits.

Hello, I’m Allie!•3/1/24, 6:37 AM

That one isn’t an imposed limit iirc, but just with how fast D1 can process a query, coupled with the fact that it isn’t multithreaded

HHello, I’m Allie!So it is an increment, plus a read? What you could do is push to AE, then have a...

quisi.do•3/1/24, 6:38 AM

I don't believe I currently have access to DO on free tier. I imagine I'll inevitably require paid tier but right now I'm just building PoCs so the gated services kinda make that hard.

Hello, I’m Allie!•3/1/24, 6:38 AM

You could also use R2, if that is the issue

quisi.do•3/1/24, 6:39 AM

Wrong reply, sorry.

Qquisi.do I don't believe I currently have access to DO on free tier. I imagine I'll inevi...

Hello, I’m Allie!•3/1/24, 6:39 AM

My method doesn’t require a DO?

Hello, I’m Allie!•3/1/24, 6:39 AM

All good

quisi.do•3/1/24, 6:39 AM

I meant the quote above yours.

quisi.do•3/1/24, 6:40 AM

I wish the limits and pricing for every service were side by side. Maybe I'll make a table for that just to keep my sanity.

quisi.do•3/1/24, 6:45 AM

Trade off is more expensive for less latency and faster consistency, right?

Qquisi.do Trade off is more expensive for less latency and faster consistency, right?

Hello, I’m Allie!•3/1/24, 6:45 AM

The big thing is that KV scales basically infinitely

quisi.do•3/1/24, 6:45 AM

I wonder if I should be concerned with D1 read latency on every request

quisi.do•3/1/24, 6:46 AM

My wallet doesn't lmao

Hello, I’m Allie!•3/1/24, 6:46 AM

D1, since it is a single isolate somewhere, can only handle so many requests

quisi.do•3/1/24, 6:46 AM

It's in us east IIRC

Qquisi.do It's in us east IIRC

Hello, I’m Allie!•3/1/24, 6:47 AM

I meant more, because it is only one isolate, it can at best handle a few thousand rps(and that is without all of the SQLite machinery running every query)

Hello, I’m Allie!•3/1/24, 6:48 AM

And the values aren’t cached either, so every request is backhauled to the database. You can remedy that yourself tho

oh cpu time is quite different from actual time right?

Similar Threads

Similar Threads

Similar Threads