Cloudflare Developers•2y ago

The surprising thing is if I do this in Bangalore, it terminates in SFO according to geolocation loo

The surprising thing is if I do this in Bangalore, it terminates in SFO according to geolocation look up.

SSantosh The surprising thing is if I do this in Bangalore, it terminates in SFO accordin...

Chaika•4/3/24, 12:58 AM

that's not surpising, geolocation with anycast ips like CF is always wrong

SantoshOP•4/3/24, 12:58 AM

How do I know the real location? SFO seems irreasonable with that latency

Chaika•4/3/24, 12:58 AM

That IP exists in more then one location (anycast) so it's hard to assign a single location to it

SantoshOP•4/3/24, 12:59 AM

Yes, Anycast it is!

SSantosh How do I know the real location? SFO seems irreasonable with that latency

Chaika•4/3/24, 1:00 AM

In general, you can go to

/cdn-cgi/trace

/cdn-cgi/trace

path of your website, ex:

https://d1-a-ut.makemyparty.live/cdn-cgi/trace

https://d1-a-ut.makemyparty.live/cdn-cgi/trace

, and look at

colo={airportcode}

colo={airportcode}

, and that airport code is the identifider of the location you hit

Chaika•4/3/24, 1:00 AM

Of course, you can't do that with most looking glasses, so you just have to guess by ping time or if traceroute or reverse dns exposes something obvious. Sometimes you'll see one of the end IPs be an Internet Exchange making it pretty obvious

SantoshOP•4/3/24, 1:01 AM

And I would have to do this from within India if I want to really locate that colo (in this particular case)

SantoshOP•4/3/24, 1:02 AM

Is there a cloudflare utility like thatof Vultr that allows me to trace it locally to a region?

Chaika•4/3/24, 1:02 AM

for example:

Chaika•4/3/24, 1:02 AM

if you google

38.10.0.47

38.10.0.47

, you get a peering db result, it's CF's IP for them on Extreme IX in Bangalore, so it's most likely going to Cf's Banglore colo

SantoshOP•4/3/24, 1:02 AM

gotcha!

Chaika•4/3/24, 1:03 AM

should probably go to #off-topic or #general-help since this isn't workers related

az•4/3/24, 1:20 AM

if i am using durable objects for rate limiting should i use an alarm to delete buckets that are inactive?

dave•4/3/24, 1:25 AM

Is there a way I can have my Worker "push" data back so that the client doesn't disconnect?

dave•4/3/24, 1:32 AM

is there a 100,000 ms limit or something on a Worker?

James•4/3/24, 1:37 AM

100s is the default timeline for Cloudflare http things

dave•4/3/24, 1:41 AM

I increased the proxy timeout to 6000s; I thought that would apply?

JJames 100s is the default timeline for Cloudflare http things

dave•4/3/24, 3:27 AM

Is there no easy way to increase that?

jessejessejesse•4/3/24, 6:00 AM

Hi all, I'm building an API. I need to find some data from a relatively large file (1~3 GB). The file is encrypted, so I also need a functional algorithm to decode the data from the file. What data storage solution should I choose? Thank you.

Robin Lindner•4/3/24, 6:37 AM

Is there a max body size in Cloudflare Workers? I need to handle files (using FormData for example) up to 2GB

RRobin Lindner Is there a max body size in Cloudflare Workers? I need to handle files (using Fo...

Sam•4/3/24, 7:41 AM

100MB for the free Cloudflare plan https://developers.cloudflare.com/workers/platform/limits/#request-limits

Cloudflare Docs

Limits · Cloudflare Workers docs

Cloudflare Workers plan and platform limits.

vakno•4/3/24, 8:43 AM

Hello, is it possible to modify HTML of react site using cloudflare workers with HTMLRewriter?
If my understanding is correct cloudflare workers modify HTTP responses.
But on react site there is not a new HTTP request when page is loaded because react works by changing DOM content.
Any help and explanations would be greatly appreciated!

Vvakno Hello, is it possible to modify HTML of react site using cloudflare workers with...

Hello, I’m Allie!•4/3/24, 8:51 AM

HTMLRewriter can only modify HTML that exists Server-Side. Generally, React uses a single div, that is then populated on the client side. So unless you can get React to do some of the work on the server, then no

dave•4/3/24, 11:55 AM

✘ [ERROR]   Error: Request closed due to connection limit

✘ [ERROR]   Error: Request closed due to connection limit

dave•4/3/24, 11:55 AM

wat, I thought more than 5 subrequest connections would just queue up?

Ddave ``` ✘ [ERROR] Error: Request closed due to connection limit ```

Hello, I’m Allie!•4/3/24, 12:08 PM

Maybe you are hitting this?

HHello, I’m Allie!Maybe you are hitting this?

dave•4/3/24, 12:10 PM

na, I am not doing anywhere near 1000 requests

Ddave na, I am not doing anywhere near 1000 requests

Hello, I’m Allie!•4/3/24, 12:10 PM

How about 50?

HHello, I’m Allie!How about 50?

dave•4/3/24, 12:12 PM

nope. I'm doing:

5 subrequests to R2 through the bindings.
5 subrequests to the Cache API
2 subrequests to Backblaze B2

If I await between the R2 put's and the Cache API put's, the error goes away.

Ddave nope. I'm doing: 5 subrequests to R2 through the bindings. 5 subrequests to the...

Hello, I’m Allie!•4/3/24, 12:14 PM

Might be this?

If the system detects that a Worker is deadlocked on open connections — for example, if the Worker has pending connection attempts but has no in-progress reads or writes on the connections that it already has open — then the least-recently-used open connection will be canceled to unblock the Worker.

If the Worker later attempts to use a canceled connection, an exception will be thrown. These exceptions should rarely occur in practice, though, since it is uncommon for a Worker to open a connection that it does not have an immediate use for.

Otherwise, not sure what it could be

HHello, I’m Allie!*Might* be this? > If the system detects that a Worker is deadlocked on open con...

dave•4/3/24, 12:14 PM

I wonder if there's an undocumented limit still for internal subrequests

Ddave I wonder if there's an undocumented limit still for internal subrequests

Hello, I’m Allie!•4/3/24, 12:15 PM

I don't think so? Pretty sure I've run 20+ concurrently before

HHello, I’m Allie!*Might* be this? > If the system detects that a Worker is deadlocked on open con...

dave•4/3/24, 12:15 PM

wouldn't that be an exception, not a "Too many subrequests"?

Ddave wouldn't that be an exception, not a "Too many subrequests"?

Hello, I’m Allie!•4/3/24, 12:16 PM

HHello, I’m Allie!I don't think so? Pretty sure I've run 20+ concurrently before

dave•4/3/24, 12:16 PM

to the cache api?

Hello, I’m Allie!•4/3/24, 12:16 PM

I would assume not, but can't be sure just from the dash

Ddave to the cache api?

Hello, I’m Allie!•4/3/24, 12:16 PM

The Cache API, DOs, KV. 20+ each

Hello, I’m Allie!•4/3/24, 12:16 PM

I can try passing it up to see, but otherwise, might be worth a ticket

HHello, I’m Allie!The Cache API, DOs, KV. 20+ each

dave•4/3/24, 12:25 PM

huh, weird.

HHello, I’m Allie!The Cache API, DOs, KV. 20+ each

dave•4/3/24, 12:27 PM

with the same ReadableStream source?

dave•4/3/24, 12:30 PM

for context, what I'm doing, is shoving the same data into five R2 buckets in each region, and also pushing it into the Cache API (so I avoid a Class B completely in even more situations).

Ddave with the same ReadableStream source?

Hello, I’m Allie!•4/3/24, 12:52 PM

No, they were different. Just got a response though, so looks like what you were doing(awaiting them halfway through) is what you are supposed to do

HHello, I’m Allie!No, they were different. Just got a response though, so looks like what you were...

dave•4/3/24, 12:52 PM

oh, why is that? I thought this would cause buffering and be bad.

Ddave oh, why is that? I thought this would cause buffering and be bad.

Hello, I’m Allie!•4/3/24, 1:02 PM

cache.put

cache.put

doesn't actually return anything, just an empty promise. R2 does return an

R2Object

R2Object

, but that doesn't actually include the body. For the two requests to Backblaze, you can call

response.body.cancel()

response.body.cancel()

to ensure they are closed

HHello, I’m Allie!`cache.put` doesn't actually return anything, just an empty promise. R2 does ret...

dave•4/3/24, 1:03 PM

I mean buffering of the input

Ddave I mean buffering of the input 🙂

Hello, I’m Allie!•4/3/24, 1:04 PM

Well, they wouldn't be processed entirely in parallel anyway, since it would only be running half of them at once

Hello, I’m Allie!•4/3/24, 1:04 PM

So it would already be buffering it somewhere

HHello, I’m Allie!Well, they wouldn't be processed entirely in parallel anyway, since it would onl...

dave•4/3/24, 1:05 PM

hm, good point. I guess it'll probably be fine, since I only take in files <100MB

Ddave hm, good point. I guess it'll probably be fine, since I only take in files <100M...

Hello, I’m Allie!•4/3/24, 1:06 PM

Otherwise, you can put it to R2, then pull it back out into Cache. Might be convoluted, but

The surprising thing is if I do this in Bangalore, it terminates in SFO according to geolocation loo

Similar Threads