Is there a way to impose a hard limit of 1 actively running request per user id (or any identifier)

Is there a way to impose a hard limit of 1 actively running request per user id (or any identifier) per location. I'm currently using a simple KV with a bool, but it's not quite fast enough if you make two requests at the same time. Would a queue be a good fit for this or is there a simpler solution?

HhfcRed Is there a way to impose a hard limit of 1 actively running request per user id ...

Cyb3r-Jak3•9/3/24, 12:31 PM

You should look at durable objects

hfcRedOP•9/3/24, 12:32 PM

Ahhhh yeah that makes sense, thank you!

gx•9/3/24, 6:34 PM

For only one account we have in cloudflare and all domians are working fine yesterday, today after enable the 2FA dashboard not showing domains . after that revoking 2FA but still same issue help ASAP...

Corsix👾•9/3/24, 6:52 PM

is it needed/worth adding queues to my worker when jobs are triggerd from page functions? or if i have a Service binding to the worker from my page projects will it always work.. ?

Ashley•9/3/24, 7:19 PM

Service Bindings are a zero-cost abstraction, so while “always work” is probably never going to the case for anything in software engineering, imo it is reliable enough where you can assume it’s going to work - typically the call in the secondary worker happens in the same thread on the same Cloudflare server as the calling worker, so there’s no networking etc. - up to you to decide for your use case, and more info at https://developers.cloudflare.com/workers/runtime-apis/bindings/service-bindings/

Cloudflare Docs

Service bindings | Cloudflare Workers docs

Facilitate Worker-to-Worker communication.

Corsix👾•9/3/24, 7:49 PM

alright, sounds good. thanks for the insight!

Ashley•9/4/24, 9:14 AM

I haven’t looked at the repo, but is this as part of an API call, or a user interaction on a website? If it’s the former, is there a reason to use the queue rather than just process it in the worker directly? If it’s a website where the user enters the URL, you can have the first backend call put the URL in the queue, and then have the frontend poll a separate endpoint to see if the result is in KV, as an option. You can also do the same approach if it’s an API to be honest: have a POST request to create jobs, then a separate GET request to see if the job has completed (or offer a webhook that sends the response when it’s ready). Really depends on your use case.

Ashley•9/4/24, 9:32 AM

Peeked at the repo - it's sort of what it does. You can see that there is the endpoint to add to the queue in https://github.com/cloudflare/queues-web-crawler/blob/master/pages/functions/requestToCrawlSite.js and then it gives a link to a URL that is handled by https://github.com/cloudflare/queues-web-crawler/blob/master/pages/functions/page/%5Burl%5D.js to show the results

Abakir•9/4/24, 3:23 PM

https://developers.cloudflare.com/workers/wrangler/environments/

Can booth the dev and production worker have the same name and live undertneath one service in cloudflare, but use different routes that is defined underneath the worker

Cloudflare Docs

Environments | Cloudflare Workers docs

Deploy the same Worker application with different configuration for each environment.

AAbakir https://developers.cloudflare.com/workers/wrangler/environments/ Can booth the ...

Ashley•9/4/24, 4:17 PM

It's in the docs you linked:

Wrangler appends the environment name to the top-level name to deploy a Worker. For example, a Worker project named my-worker with an environment [env.dev] would deploy a Worker named my-worker-dev.

Wrangler appends the environment name to the top-level name to deploy a Worker. For example, a Worker project named my-worker with an environment [env.dev] would deploy a Worker named my-worker-dev.

So no, they cannot have the same name - you can map multiple routes to a single environment, but you can't have dev/production with the same name but different bindings etc.

Abakir•9/4/24, 4:18 PM

Yea that makes sense I was just making sure

Nnil this would be as part of an API call, so i would ideally like just have one fetc...

Ashley•9/4/24, 7:34 PM

Have you tried using a Durable Object instead of a queue? See: https://developers.cloudflare.com/browser-rendering/get-started/browser-rendering-with-do/ it should allow you to achieve the same outcome but a DO is more suited to a synchronous workflow

Cloudflare Docs

Deploy a Browser Rendering Worker with Durable Objects | Browser Re...

By following this guide, you will create a Worker that uses the Browser Rendering API along with Durable Objects to take screenshots from web pages and store them in R2.

lifeiscontent•9/5/24, 2:10 AM

for load context, is that something you should stuff things like auth, db, session management tools into?

HHard@Work Workers(Unbound isn't really a thing anymore), while not a dedicated "heavy-comp...

sakura•9/5/24, 4:23 AM

Is this per HTTP request or 30s across all HTTP requests?

Ssakura Is this per HTTP request or 30s across all HTTP requests?

Ashley•9/5/24, 8:33 AM

Per HTTP request (https://developers.cloudflare.com/workers/platform/limits/#worker-limits for full details) and everyone is on the Standard pricing model now

Cloudflare Docs

Limits | Cloudflare Workers docs

Cloudflare Workers plan and platform limits.

majestic•9/5/24, 9:08 AM

Can enterprise users have static ip ?

Ssakura Is this per HTTP request or 30s across all HTTP requests?

Hard@Work•9/5/24, 9:27 AM

Per request

Mmajestic Can enterprise users have static ip ?

Walshy•9/5/24, 9:36 AM

https://developers.cloudflare.com/aegis/

Cloudflare Docs

Overview | Cloudflare Aegis docs

Cloudflare Aegis provides dedicated egress IPs (from Cloudflare to your origin) for your layer 7 WAF and CDN services. The egress IPs are reserved exclusively for your account so that you can increase your origin security by only allowing traffic from a small list of IP addresses.

mo246•9/5/24, 11:04 AM

Hi guys I’m new here, I’m a total noob so excuse any wrong terms I may use. I made a chrome extension that uses AI (Anthropic API) to generate replies to reviews. So in order to protect my api key from client side code I wanted to use workers as a “middle man”. My front end would call the worker then the worker would call Anthropic and then send back the response to my front end. However I have two security issues:

Can anyone not just get the worker url from my code (chrome extension code can be downloaded) and make their own requests to the worker?
Is there a way to limit requests to the worker? Again, can someone not access the url and maliciously make like a million calls to the end point?

It’s based on usage so I’m afraid of racking up a high bill. I currently used netlify functions but after reading stories on them I want to move away. I thought AI Gateway was the savior but turns out it just for analytical purposes? As you have to add your API key

Ashley•9/5/24, 11:58 AM

FWIW this would also be a problem if you used any other means to expose your backend (e.g. a VPS). You can try to limit the potential abuse further by requiring users to login via Google or something - and then only allowing authenticated users to hit the endpoint (validate they have a JWT or w/e you want to do). Of course people can sign in and then send millions of requests if they want to, but it makes it a bit more difficult/effort and that's generally what a lot of security is about.

I'd also recommending setting a spending limit in your Anthropic account, not sure what controls they give you, but most offer spending caps - so at least if you do get hit, it will be limited, and you can start out with a low spend if you're expecting slow and gradual uptake.

mo246•9/5/24, 1:48 PM

Thanks yea that’s what I was recommended, setting up proper auth. The issue isn’t with over spending on Anthropic but the worker/function. Anthropic is prepaid so if I put $10 it only uses that much and no more unless I have auto recharge on which I won’t. I’m not concerned about users abusing it but someone who can download the source code files and see the url in the code that I use to generate replies. It just seem to be a bigger problem than just putting the api key in code. Someone can use my api key but I have a limit on it.

Avi•9/5/24, 2:21 PM

Avi•9/5/24, 2:21 PM

is this a cloudflare error? never seen it before

Avi•9/5/24, 2:21 PM

we’re using DurableObjects

AAvi Click to see attachment

Hard@Work•9/5/24, 2:22 PM

That sounds like a JS error when you call too many setTimeout()setTimeout() without them resolving

HHard@Work That sounds like a JS error when you call too many `setTimeout()` without them r...

Avi•9/5/24, 2:23 PM

hmm yeah that was my thought too…. are we expected to be manually calling clearTimeout?

johtso•9/5/24, 2:23 PM

how do you specify what account to deploy to when you have multiple accounts authenticated?

johtso•9/5/24, 2:26 PM

can I put an account id in a default config in the top level of my monorepo?

AAvi hmm yeah that was my thought too…. are we expected to be manually calling clearT...

Hard@Work•9/5/24, 2:27 PM

If you are generating a lot of them, then don't need them all, I would do so, yeah

Jjohtso can I put an account id in a default config in the top level of my monorepo?

Hard@Work•9/5/24, 2:27 PM

No, but you can put the account ID in your wranglerwrangler config

HHard@Work If you are generating a lot of them, then don't need them all, I would do so, ye...

Avi•9/5/24, 2:28 PM

we probably shouldn’t be generating too many… 10K simultaneous sounds like a bug of some kind for sure. we probably only spin up several hundred DOs in a 10 minute period

HHard@Work No, but you can put the account ID in your `wrangler` config

johtso•9/5/24, 2:40 PM

that's not ideal as it's my work account and I don't want it to affect my personal account

johtso•9/5/24, 2:41 PM

so I really want it to be global but just for the project/directory/monorepo

Jjohtso that's not ideal as it's my work account and I don't want it to affect my person...

Hard@Work•9/5/24, 2:45 PM

Not sure I understand? If you put the ID in your config, then it only applies to that one Worker/Pages Project

HHard@Work Not sure I understand? If you put the ID in your config, then it only applies to...

johtso•9/5/24, 2:52 PM

oh, I think I misunderstood what you meant by "your" config.. do you just mean the project config? there are many workers in my monorepo, wanted to avoid hardcoding the account id into all of them

Jjohtso oh, I think I misunderstood what you meant by "your" config.. do you just mean t...

Hard@Work•9/5/24, 2:52 PM

Yeah, that's what I meant. There isn't currently a way to make them inherit an account ID from somewhere else

Hard@Work•9/5/24, 2:53 PM

Unless you want to add an Environment Variable that you can somehow scope to just that directory

johtso•9/5/24, 2:55 PM

ohh, that could work

lifeiscontent•9/5/24, 6:13 PM

why is pages recommend over worker sites? It seems like Worker Sites is more powerful

Llifeiscontent why is pages recommend over worker sites? It seems like Worker Sites is more pow...

Chaika•9/5/24, 6:23 PM

In what way? Pages has built in CI/CD, supports advanced mode so you can pop out of the provided stuff and use it more like Worker Sites, free unlimited static asset requests, versioning/rollbacks/etc

CChaika In what way? Pages has built in CI/CD, supports advanced mode so you can pop out...

lifeiscontent•9/5/24, 6:24 PM

can't seem to use durable objects / D1 Transactions but maybe I'm doing something wrong?

Devon•9/5/24, 6:25 PM

Yeah, the functionality venn diagram of Workers/Workers Sites and Pages/Pages Functions is... a bit awkward imho.

Llifeiscontent can't seem to use durable objects / D1 Transactions but maybe I'm doing somethin...

Chaika•9/5/24, 6:25 PM

Durable Objects have to be defined in a worker and then you can attach to in Pages, Explicit Transactions don't exist outside of batch

DDevon Yeah, the functionality venn diagram of Workers/Workers Sites and Pages/Pages F...

Chaika•9/5/24, 6:25 PM

They're working on converging Pages and Workers into one product: https://blog.cloudflare.com/pages-and-workers-are-converging-into-one-experience/

The Cloudflare Blog

Bringing a unified developer experience to Cloudflare Workers and P...

Today we’re excited to announce that over the next year we will be working to bring together the best traits and attributes you know and love from each product into one powerful platform!

Is there a way to impose a hard limit of 1 actively running request per user id (or any identifier)

Similar Threads

Similar Threads

Similar Threads