Yeah, so in this case - that one on top is a subrequest made from the Worker and the second one is t

Yeah, so in this case - that one on top is a subrequest made from the Worker and the second one is the parent request
So, request from Googlebot came in, it fired a Worker (log 2) and that Worker made a subrequest to xyz (log 1)

You can match up parent to child by the

ParentRayID

ParentRayID

ParentRayID

ParentRayID like you already mentioned

WWalshy Yeah, so in this case - that one on top is a subrequest made from the Worker and...

ElddisOne•11/20/24, 12:31 PM

Thanks Walshy, that makes sense. We want to get the RayID which is returned to the client because we're matching the log entries here against a web crawler. For example

Googlebot makes request -> Goes into CF ("RayID: 1234") -> Goes into Worker ("RayID: 5678") -> Response returned to Googlebot ("RayID: ?????")

WalshyOP•11/20/24, 12:33 PM

the response would be the highest parent, that's the request from the eyeball and the response to the eyeball

WalshyOP•11/20/24, 12:33 PM

So, 1234 in this case

WWalshy So, 1234 in this case

ElddisOne•11/20/24, 12:39 PM

Ok great. In my example above, it is just simple HTML manipulation. Another case is that we are using Workers as a way to check a redirection database too. In those instances, if the origin server is expected to return a 200 status code and we intercept it via the Worker and the Worker changes it to a 301 redirect, would it then use the parent request or the worker request? The end goal is that we are trying to figure out which entry log we need to keep for some analysis of Googlebot. At the moment, having both entries is causing havoc because it's showing a url path can be both a 200 and a 301 at the exact same timestamp

WalshyOP•11/20/24, 12:42 PM

Workers are still part of the initial request so the parent - the top level one

WWalshy Workers are still part of the initial request so the parent - the top level one

ElddisOne•11/20/24, 12:43 PM

Nice, so we can assume if there is no ParentRayID or the ParentRayID = "00" then keep it. All others entries can be disgarded.

Luke•11/20/24, 5:13 PM

I'm trying to start using worker logs on my project but need a little better control over the sampling. Is there any way that I can programmatically determine whether a requests logs should be sampled or not?

For example - I'm invoking 500MM worker requests a month and each request can log anywhere from 10-1000 messages which adds up very quickly. I don't want to persist debugdebug logs unless there is an errorerror. Or i don't want to persist any logs if its for a well known static content endpoint.

I was thinking I could just log everything and then use a tailtail worker to check for the presence of an errorerror log to decide what to send over to worker logs?

Original message was deleted

Luke•11/20/24, 6:33 PM

I see, thank you! If I were to use a tail worker and just conditionally console.logconsole.log from there w/ a 100% sample rate on that tail worker do you think that would accomplish the same thing?

Luke•11/20/24, 6:39 PM

ok thanks I'll give it a shot. With tail workers do you know if there is any way to pass it additional events/data or is it just given the results of console.log/fetch/exceptions?

LLuke I'm trying to start using worker logs on my project but need a little better con...

Thomas Ankcorn•11/21/24, 12:39 PM

For this scenario its always much easier to fix it in your code. We do plan on supporting tail sampling but you should use a logger with log level support

xintercept•11/21/24, 1:43 PM

morning all, I'm trying to disable the invocation_logsinvocation_logs through

wrangler.toml

wrangler.toml

but it's doesn't seem to be taking effect, and resets to being enabled on each deploy - anyone hit anything similar?

Xxintercept morning all, I'm trying to disable the `invocation_logs` through `wrangler.toml...

xintercept•11/21/24, 1:43 PM

here's the blocks in wrangler.toml:

[env.dev.observability]
enabled = true
head_sampling_rate = 1

[env.prod.observability]
enabled = true
head_sampling_rate = 0.2

[observability.logs]
enabled = true
invocation_logs = false

[env.dev.observability]
enabled = true
head_sampling_rate = 1

[env.prod.observability]
enabled = true
head_sampling_rate = 0.2

[observability.logs]
enabled = true
invocation_logs = false

Xxintercept morning all, I'm trying to disable the `invocation_logs` through `wrangler.toml...

xintercept•11/21/24, 1:45 PM

(it would be nice to have even more control over which invocation logs are disabled, ideally I would keep the external requests, but disable the ones for queues and DOs)

Xxintercept morning all, I'm trying to disable the `invocation_logs` through `wrangler.toml...

Thomas Ankcorn•11/21/24, 4:12 PM

Are you on wrangler 3.88?

TThomas Ankcorn Are you on wrangler 3.88?

xintercept•11/21/24, 4:13 PM

yeah, 3.88.0

Saleem Padinharkkara•11/21/24, 4:14 PM

hi folks, I am new to Cloudflare. Loving it so far. But observability seems to be an issue. I am trying to integrate Baselime using the Edge Logger, but i dont see the logs in my baselime namespace

Xxintercept yeah, 3.88.0

Thomas Ankcorn•11/21/24, 4:14 PM

Ooh it looks like you need to set env.prod.observability.logs to invocation_logs = false

TThomas Ankcorn Ooh it looks like you need to set env.prod.observability.logs to invocation_logs...

xintercept•11/21/24, 4:16 PM

I had tried it like this too, but had the same problem:

[env.dev.observability]
enabled = true
head_sampling_rate = 1

[env.dev.observability.logs]
enabled = true
invocation_logs = false

[env.prod.observability]
enabled = true
head_sampling_rate = 0.2

[env.prod.observability.logs]
enabled = true
invocation_logs = false

[env.dev.observability]
enabled = true
head_sampling_rate = 1

[env.dev.observability.logs]
enabled = true
invocation_logs = false

[env.prod.observability]
enabled = true
head_sampling_rate = 0.2

[env.prod.observability.logs]
enabled = true
invocation_logs = false

Xxintercept I had tried it like this too, but had the same problem: ``` [env.dev.observabili...

Thomas Ankcorn•11/21/24, 4:48 PM

Is this just in the dash drawer? That looks like a visual bug. It seems to be disabled correctly. Can you DM me your account id and worker name please so I can check for you

TThomas Ankcorn Is this just in the dash drawer? That looks like a visual bug. It seems to be di...

xintercept•11/21/24, 4:53 PM

hmm, I still see the logs, it's not until I manually disable it in the UI that comes into effect, account id sent

Magic Greg•11/21/24, 5:11 PM

hey guys - i'm not sure if this is the right channel, but i was wondering how to get the tail worker working in local dev?

MMagic Greg hey guys - i'm not sure if this is the right channel, but i was wondering how to...

Thomas Ankcorn•11/21/24, 5:14 PM

Tail doesn't work right now in local dev, best to test it in prod!

Magic Greg•11/21/24, 5:15 PM

too sad

But thanks for the reply!

SSaleem Padinharkkara hi folks, I am new to Cloudflare. Loving it so far. But observability seems to...

rohin•11/21/24, 11:01 PM

we recommend using Workers Log as its better supported now

Rrohin we recommend using Workers Log as its better supported now

-yko-•11/25/24, 7:40 PM

Can I access the content of Workers Log via API the same way as they are displayed in the dashboard?

kchro3•11/25/24, 9:23 PM

what's the retention period for the worker obs logs?

zegevlier•11/25/24, 9:30 PM

Assuming you're talking about workers logs, 7 days as per https://developers.cloudflare.com/workers/observability/logs/workers-logs/#limits

--yko-Can I access the content of Workers Log via API the same way as they are display...

rohin•11/26/24, 6:04 AM

not yet, we're working to make that available!

Rrohin not yet, we're working to make that available!

-yko-•11/26/24, 7:34 AM

Will be waiting for that to happen!

matt•11/28/24, 1:08 AM

are there any alternatives to the js implementations for opentelemetry? i find the existing lib a little heavy for what it provides

telliks•11/28/24, 11:51 AM

Is there a known issue for workers obs logs not working for Next.js apps running on workers using OpenNext? I've got 2 workers, both with observability enabled, and the one running Next.js does not show any logs.

scotto•11/30/24, 3:16 PM

Any example on to setup new relic with cloud flare workers to have traces of all outbound comunication?

DaniFoldi•12/3/24, 9:35 AM

+1 that this update ^ is weird, cc @rohin
Not seeing subrequests, wfp requests, tail logs etc in the same place is a step backwards with the new UI

Eebar0n Hi Observability team, I have an issue with the new observability logs missing u...

rohin•12/3/24, 6:15 PM

hey @ebar0n, thanks for surfacing this! We're on it. Hoping to get a quick fix in asap soyou can continue to use real-time logs with WFP. We are also looking into longer-term solutions like using Workers Logs with Workers for Platforms.

Eebar0n Question: is there any way to get the $cloudflare.$metadata.requestId property i...

rohin•12/3/24, 6:17 PM

for now, the requestId matches the rayID. You can fetch the ray ID from the request header: const rayId = request.headers.get('cf-ray');const rayId = request.headers.get('cf-ray');

yen•12/4/24, 2:57 AM

hi, wondering if the new workers logs is supporting console.log only or it will also pickup console.error?

Yyen hi, wondering if the new workers logs is supporting console.log only or it will ...

Isaac McFadyen•12/4/24, 4:25 AM

It should pick up console.error as well.

TKR👑•12/5/24, 1:56 AM

I got screwed

TKR👑•12/5/24, 1:57 AM

Why cant I add my newest joiner to the team to Baselime?? @boristane

TKR👑•12/5/24, 1:57 AM

Since the new "cloudflare logs" banner got added

TKR👑•12/5/24, 1:57 AM

No email is being sent when we invite, or when he requests to be added to team

TKR👑•12/5/24, 1:57 AM

There is literally no way to add new people

also CF logs sucks compared to Baselime... Viva Baselime!

dave•12/12/24, 1:56 PM

Just wanted to pop in and say Workers Logs are amazing! Huge fan.

Mozzy•12/12/24, 9:56 PM

My worker has suddenly stopped logging anything except logs related to errors. Only things I remember changing are setting up a bulk redirect (image 2) and adding the "Redirect from WWW to Root" template to my zone.

Yeah, so in this case - that one on top is a subrequest made from the Worker and the second one is t

Similar Threads

Similar Threads

Similar Threads