I have 2 KV bindings. EDIT: just educated myself - no, not using any service bindings, but making a

Ssherlock I have 2 KV bindings. EDIT: just educated myself - no, not using any service bin...

S

sherlockOP•5/18/24, 8:30 PM

I think I found out why - I added some waits to retry the rate limited calls, and that increases my CPU time way beyond the free limit of 10ms. (Not the ideal way to do it, I know. I'm exploring Workers so this is fun

)

U

Unsmart•5/18/24, 8:41 PM

A wait/setTimeout doesnt use CPU time, what does use CPU time is parsing the data from KV (or from the discord api) so the larger the value the more CPU time it uses. Local dev doesnt have any CPU limits thus it works fine no matter the size

U

Unsmart•5/18/24, 8:42 PM

And KV doesnt really have rate limits so I highly doubt the calls to KV are ever being retried but the 1st call will succeed

S

sherlockOP•5/18/24, 8:45 PM

My calls are to a third party api, some manipulation on the data and then create a thread and post multiple messages on that thread. But as you say, IO wait time would be different from CPU time, so I'm back to square one, on why the request gets cancelled before I return a response :/

W

Walshy•5/18/24, 9:17 PM

also canceled is not due to cpu limits

W

Walshy•5/18/24, 9:17 PM

canceled means the client cancelled the request

W

Walshy•5/18/24, 9:17 PM

so your Worker took too long to respond and the request was cancelled

W

Walshy•5/18/24, 9:17 PM

if you're using interactions, they have a pretty fixed time to respond unless you defer

W

Walshy•5/18/24, 9:18 PM

waiting for these apis and things all add to that wall time limit imposed on you

W

Walshy•5/18/24, 9:18 PM

i'd recommend deferring and responding when you can

Kkian .dev.vars is just for local development

B

Baran•5/18/24, 9:28 PM

can I not add secrets in

.dev.vars

.dev.vars

file to

wrangler.toml

wrangler.toml

?

Something like this:

name = "TBA"
compatibility_date = "2024-05-12"
compatibility_flags = ["nodejs_compat"]
pages_build_output_dir = ".vercel/output/static"

[vars]
TURSO_DATABASE_URL = "libsql://TBA.turso.io"
TURSO_AUTH_TOKEN = "TBA"

[.dev.vars]
TURSO_DATABASE_URL = "http://127.0.0.1:8080"
TURSO_AUTH_TOKEN = "TBA"

name = "TBA"
compatibility_date = "2024-05-12"
compatibility_flags = ["nodejs_compat"]
pages_build_output_dir = ".vercel/output/static"

[vars]
TURSO_DATABASE_URL = "libsql://TBA.turso.io"
TURSO_AUTH_TOKEN = "TBA"

[.dev.vars]
TURSO_DATABASE_URL = "http://127.0.0.1:8080"
TURSO_AUTH_TOKEN = "TBA"

name = "TBA"
compatibility_date = "2024-05-12"
compatibility_flags = ["nodejs_compat"]
pages_build_output_dir = ".vercel/output/static"

[vars]
TURSO_DATABASE_URL = "libsql://TBA.turso.io"
TURSO_AUTH_TOKEN = "TBA"

[.dev.vars]
TURSO_DATABASE_URL = "http://127.0.0.1:8080"
TURSO_AUTH_TOKEN = "TBA"

name = "TBA"
compatibility_date = "2024-05-12"
compatibility_flags = ["nodejs_compat"]
pages_build_output_dir = ".vercel/output/static"

[vars]
TURSO_DATABASE_URL = "libsql://TBA.turso.io"
TURSO_AUTH_TOKEN = "TBA"

[.dev.vars]
TURSO_DATABASE_URL = "http://127.0.0.1:8080"
TURSO_AUTH_TOKEN = "TBA"

K

kian•5/18/24, 9:28 PM

[vars]

[vars]

shouldn't contain secrets.

B

Baran•5/18/24, 9:29 PM

why?

K

kian•5/18/24, 9:29 PM

Because that's what secrets are for. They can't be seen in the dashboard and aren't in files that you commit to VCS (like Wrangler.toml)

K

kian•5/18/24, 9:30 PM

It's a shouldn't, not a can't - if you really want to you can but it isn't best practice.

B

Baran•5/18/24, 9:30 PM

so what is the alternative?

K

kian•5/18/24, 9:30 PM

The message you replied to is in the conversation that explains it

K

kian•5/18/24, 9:31 PM

.dev.vars for local development, and secrets for production

W

Walshy•5/18/24, 9:31 PM

(

wrangler secret put

wrangler secret put

wrangler secret put

wrangler secret put to upload a secret for prod)

B

Baran•5/18/24, 9:41 PM

environment variables are:

variables that get set to different values based on the code's environment that is running on.
plain text (and visible on the dashboard) or encrypted (and not visible on the dashboard).
also known as "binding"s.

secrets are a type of environment variables that are encrypted and not visible on the dashboard. They are set via

Wrangler

Wrangler

Wrangler

Wrangler

B

Baran•5/18/24, 9:41 PM

is my understanding correct?

Y

YokoWasis•5/19/24, 2:41 AM

Anyone here use Argo smart routing with workers? My workers throwing CORS error. When I open the url from browser.

When I change it to argo smart routing, it suddenly has captcha, probably that's the reason.

Any idea how to fix this?

Edit :
Turns out my domain is set to "under attack" a few years back.

M

matt•5/19/24, 7:30 AM

are there any ways to avoid having to drill the

env

env

parameter through all the functions? i know you can't do something like

const secret = process.env.MY_SECRET

const secret = process.env.MY_SECRET

const secret = process.env.MY_SECRET

const secret = process.env.MY_SECRET at the top of a file and have it work like a node server, but surely there must be some other way to read from env without all this drilling

M

matt•5/19/24, 7:31 AM

maybe something with AsyncLocalStorage?

M

matt•5/19/24, 7:34 AM

I guess i could use esbuild --define to replace

process.env.X

process.env.X

process.env.X

process.env.X during the build, but probably not a good idea to do that with secrets. i wonder what other options there are

Mmatt maybe something with AsyncLocalStorage?

H

Hello, I’m Allie!•5/19/24, 7:42 AM

ALS is a good choice there

H

Hello, I’m Allie!•5/19/24, 7:42 AM

Though as you noted, you need to make sure it isn’t called directly in the global scope

M

matt•5/19/24, 7:43 AM

thanks @HardlyWorkin' or workin hard. do you know if there are any examples floating about of using ALS instead of "env drilling" for want of a better term

JJoeDoe How do I disable the prompt each time there is a error?

E

Enduriel•5/19/24, 8:38 AM

has anyone been able to find an answer to this? find the

Would you like to report this error to Cloudflare?

Would you like to report this error to Cloudflare?

Would you like to report this error to Cloudflare?

Would you like to report this error to Cloudflare? prompt really irritating

A

abuff•5/19/24, 1:49 PM

hi am new to clould flare and learning, i have deployed my first default worker and as soon as i deployed it it already had like 20 requests, without me doing anything, is that normal ? what are those requests ?

Aabuff hi am new to clould flare and learning, i have deployed my first default worker ...

C

Cyb3r-Jak3•5/19/24, 1:58 PM

Bots scrape the SSL certificate logs and send requests to new hosts.

CCyb3r-Jak3 Bots scrape the SSL certificate logs and send requests to new hosts.

A

abuff•5/19/24, 2:00 PM

Thanks, they are sure fast starting scraping, like instant, hope they do not eat up too much of the free tier

Aabuff Thanks, they are sure fast starting scraping, like instant, hope they do not eat...

C

Cyb3r-Jak3•5/19/24, 2:02 PM

It can help to disable the workers.dev subdomain for a bit when first creating the worker. Means the bots will get rejected when they first try it

N

neoney•5/19/24, 3:52 PM

for storing profile pictures and other kinds of pictures (like product images uploaded), should I use R2 or Cloudflare Images (stored)?

N

neoney•5/19/24, 3:52 PM

which is more worth it?

CCyb3r-Jak3 It can help to disable the workers.dev subdomain for a bit when first creating t...

A

abuff•5/19/24, 5:05 PM

Thanksss for the tip !

S

skoogeer•5/19/24, 9:12 PM

Hey everyone, MailChannels will be discontinuing our free API service as of June 30th. Details are in this knowledgebase article: https://support.mailchannels.com/hc/en-us/articles/26814255454093-End-of-Life-Notice-Cloudflare-Workers

I would post this in the community forum, but for some reason access was blocked.

Help Center

End of Life Notice - Cloudflare Workers

Since launching our free email sending API for Cloudflare Workers customers, we have been proud to provide a simple yet effective solution to deliver messages from Workers code with a minimum of se...

S

skoogeer•5/19/24, 9:13 PM

Starting next week, you may notice a small fraction (1%) of your connections are rejected with an error message containing a link to the same announcement. Any messages that are accepted by the service will be delivered as usual and we will continue to provide support as usual until the final day of service.

Sskoogeer Hey everyone, MailChannels will be discontinuing our free API service as of June...

J

James•5/19/24, 9:40 PM

Ah, good to hear. We've been advising people to avoid this partnership for quite some time, so it's good to get an official End of Life notice.

Sskoogeer Hey everyone, MailChannels will be discontinuing our free API service as of June...

J

James•5/19/24, 10:06 PM

Not sure why you can't access the community, but I've made the announcement there so folks are aware: https://community.cloudflare.com/t/mailchannels-end-of-life-notice-migrate-now/658638

S

skoogeer•5/19/24, 10:07 PM

Thanks, @James. I figured you would take up the challenge.

J

James•5/19/24, 10:12 PM

Happy to help

J

JoeDoe•5/20/24, 5:00 AM

What's the best way to cache data from D1 used by a api request via workers?
I need simple data from the D1 database like userCount via a api request, but quering the database on each request doesn't seem optimal.
Is there a way to save the data in some global variable or some caching mechanism so the d1 database isn't queried often?

P

peterz•5/20/24, 9:21 AM

Hello, is it ok to use the same worker for

scheduled

scheduled

and

fetch

fetch

? Are there any downsides to it?

Z

zegevlier•5/20/24, 9:43 AM

That is perfectly fine to do. There aren't any real downsides, other than that the two calling methods will both be listed in analytics for the same worker. If your scheduled takes a lot more CPU time, that would throw off your averages for request CPU time usage.

A

avogadro•5/20/24, 1:09 PM

I noticed new error recently when deploying with

upload_source_maps=true

upload_source_maps=true

upload_source_maps=true

upload_source_maps=true.

✘ [ERROR] A request to the Cloudflare API (/accounts/.../workers/scripts/...) failed.

  sourcemap index.js.map is too large, must not exceed 5MB [code: 10021]
  
  If you think this is a bug, please open an issue at: https://github.com/cloudflare/workers-sdk/issues/new/choose

✘ [ERROR] A request to the Cloudflare API (/accounts/.../workers/scripts/...) failed.

  sourcemap index.js.map is too large, must not exceed 5MB [code: 10021]
  
  If you think this is a bug, please open an issue at: https://github.com/cloudflare/workers-sdk/issues/new/choose

✘ [ERROR] A request to the Cloudflare API (/accounts/.../workers/scripts/...) failed.

  sourcemap index.js.map is too large, must not exceed 5MB [code: 10021]
  
  If you think this is a bug, please open an issue at: https://github.com/cloudflare/workers-sdk/issues/new/choose

✘ [ERROR] A request to the Cloudflare API (/accounts/.../workers/scripts/...) failed.

  sourcemap index.js.map is too large, must not exceed 5MB [code: 10021]
  
  If you think this is a bug, please open an issue at: https://github.com/cloudflare/workers-sdk/issues/new/choose

My worker is relatively small with a short list of dependencies (prisma, @planetscale/database, zod), and source map comes out to be around ~7MB. The 5MB limit seems very low. I had to disable source_maps for this worker, but I'd imaging a simple worker that is just proxying calls to a database is going to be a frequent use case of workers.

K

kaneki•5/20/24, 1:50 PM

ive made a normal worker with eventemitter and it works fine as long as its in the same file, when i put the

bot.on()

bot.on()

bot.on()

bot.on() function in an separate file it stops to work why is that?

K

kaneki•5/20/24, 1:51 PM

the

bot.on()

bot.on()

bot.on()

bot.on() function in a separate file,

index.js

index.js

index.js

index.js and

castam.js

castam.js

castam.js

castam.js are in the same directory

K

kaneki•5/20/24, 2:38 PM

as far as i can see eventemitter doesn't work between 2 files...

I have 2 KV bindings. EDIT: just educated myself - no, not using any service bindings, but making a

Similar Threads

Similar Threads

Similar Threads