I think you have most of the useful stuff though, you could grab the edge client port for fun if you

I think you have most of the useful stuff though, you could grab the edge client port for fun if you wanted too

cf.edge.client_port

cf.edge.client_port

cf.edge.client_port

cf.edge.client_port, something you can only get by passing it down.

dave•1/29/24, 9:23 PM

I'll make them lower case though, good point

CChaika I think you have most of the useful stuff though, you could grab the edge client...

dave•1/29/24, 9:24 PM

good idea, added!

dave•1/29/24, 9:24 PM

ChaikaOP•1/29/24, 9:24 PM

metal and colo id can be genuinely helpful at identifying cache stuff

ChaikaOP•1/29/24, 9:25 PM

well not really metal, but colo

CChaika metal and colo id can be genuinely helpful at identifying cache stuff

dave•1/29/24, 9:25 PM

yeah, so for context this is for long term error logging

dave•1/29/24, 9:25 PM

since Azure support sucks

kian•1/29/24, 9:25 PM

cf.verified_bot_categorycf.verified_bot_category is cool too

CChaika I think you have most of the useful stuff though, you could grab the edge client...

dave•1/29/24, 9:26 PM

weird, I got "x-client-port": "0","x-client-port": "0", on my first attempt

Kkian `cf.verified_bot_category` is cool too

Hello, I’m Allie!•1/29/24, 9:26 PM

Is there a verified_bot_nameverified_bot_name?

Ddave weird, I got `"x-client-port": "0",` on my first attempt

ChaikaOP•1/29/24, 9:26 PM

did you already have a connection established?

HHello, I’m Allie!Is there a `verified_bot_name`?

kian•1/29/24, 9:26 PM

nop

dave•1/29/24, 9:27 PM

https://gist.github.com/Manouchehri/bee48c7c931ec1ded12283fc94ae7e3e

dave•1/29/24, 9:27 PM

^ example of part of the stuff I'm logging

CChaika did you already have a connection established?

dave•1/29/24, 9:28 PM

I opened one with curl

Kkian nop

Hello, I’m Allie!•1/29/24, 9:28 PM

Darn

Original message was deleted

Hello, I’m Allie!•1/29/24, 9:29 PM

Do you have to have a dedicated UA, or just not spoof someone else's?

Hello, I’m Allie!•1/29/24, 9:29 PM

Because I feel like I've seen some crawlers with pretty generic UAs

Kkian `cf.verified_bot_category` is cool too

dave•1/29/24, 9:30 PM

yeah, already logging verifiedBotCategoryverifiedBotCategory since I do a json.stringify on the cfcf request object

Original message was deleted

Hello, I’m Allie!•1/29/24, 9:30 PM

Yeah, so if you have IP verify + regex, then you may have two crawlers with similar/same UA, that are differentiated by their IPs, no?

Kkian `cf.verified_bot_category` is cool too

dave•1/29/24, 9:31 PM

anything else?

CChaika I think you could get the worker via `http.request.headers["cf-worker"][0]`, not...

dave•1/29/24, 9:32 PM

hang on, isn't this pointless since I already log the request headers in my Worker?

Ddave hang on, isn't this pointless since I already log the request headers in my Work...

ChaikaOP•1/29/24, 9:33 PM

that's what I said lol workers-and-pages-discussions

dave•1/29/24, 9:33 PM

oh derp

dave•1/29/24, 9:33 PM

is there any situation where it could change or be helpful?

dave•1/29/24, 9:34 PM

I'll remove it for now

Original message was deleted

dave•1/29/24, 9:38 PM

easier to parse without concat'ing, as I'd be worried that that field might be missing.

dave•1/29/24, 9:39 PM

I think it's just parsing that I was worried about

dave•1/29/24, 9:40 PM

is there a way to pad http.request.timestamp.msec to include the the first two leading zeros?

dave•1/29/24, 9:41 PM

yeah

dave•1/29/24, 9:41 PM

I feel like I got annoyed when I thought of this last time lol

dave•1/29/24, 9:41 PM

ehhhhhhhhhhhhhh

dave•1/29/24, 9:42 PM

I know we have some Workers that already use timestamp-msec-onlytimestamp-msec-only

Beyondo•1/29/24, 10:01 PM

Google reCAPTCHA no longer provides 1 million free assessments.

Turnstile time.

Unsmart•1/29/24, 10:04 PM

that is until u hit over 1m and recaptcha is cheaper LUL

is interesting though very large downgrade in the free

Beyondo•1/29/24, 10:06 PM

Jokes on you, I'd never hit that! laugh_naruto

Beyondo•1/29/24, 10:06 PM

And yea, that was my only reason for using it))

Unsmart•1/29/24, 10:08 PM

I guess actually if u use managed mode turnstile is unlimited free forgot they did that

Beyondo•1/29/24, 10:09 PM

yeah, was just about to say that! i also remembered them being free & unlimited so I checked

Beyondo•1/29/24, 10:09 PM

cloudflare is awesome

Unsmart•1/29/24, 10:09 PM

Can still use other modes limited at 1 million I think but I assume managed mode is fine for 99% of people so

Ddave weird, I got `"x-client-port": "0",` on my first attempt

dave•1/29/24, 10:16 PM

ah, client_portclient_port is 00 for requests sent via WARP. That's cool.

UUnsmart I guess actually if u use managed mode turnstile is unlimited free forgot they d...

dave•1/29/24, 10:19 PM

what's wrong with managed mode? Can't you sorta use it like non-interactive if you really want to anyway?

Unsmart•1/29/24, 10:20 PM

I assume managed mode is fine for 99% of people so

dave•1/29/24, 10:39 PM

yeah but even if it isn't, can't you just put a managed in an offscreen area of the screen, and then use the callbacks?

Iggy•1/29/24, 10:55 PM

I have a very simple worker that takes in a url, fetches it, adds a 5 second TTL, and then returns a response. when I spam refresh in my browser, I only get 1 request to the origin per 5 seconds (correct). when I do the same request spam using curl, multiple origin hits happen. anybody know what's going on?

Unsmart•1/29/24, 11:05 PM

Cache is per datacenter and your browser will stick generally to 1 datacenter (though it can switch) and curl will not. A single colo can also have multiple datacenters. So just because you only hit "DFW" doesnt mean you will hit the same cache.

Iggy•1/29/24, 11:07 PM

huh interesting. that makes sense, but wouldn't copying the browser request as curl be as close to a 1:1 as possible?

Iggy•1/29/24, 11:08 PM

is there a magic incantation to add to the curl request to mimic the browser behavior?

Iggy•1/29/24, 11:11 PM

I feel like the hit ratio would be really low if you consider the curl path to be the more common use case (i.e multiple browsers in the same geographical region), no?

I think you have most of the useful stuff though, you could grab the edge client port for fun if you

Similar Threads