I know theres `ParentRayID` which points you to the request that triggered it

E

ErisaOP•7/5/23, 4:25 PM

But not seeing one to get the worker name https://developers.cloudflare.com/logs/reference/log-fields/zone/http_requests/

EErisa I know theres `ParentRayID` which points you to the request that triggered it

D

dave•7/5/23, 4:36 PM

ahhhh thank you, confusingly ParentRayID ends and starts with the exact same characters, with only four in the middle that differ. I thought they were the same at first.

E

ErisaOP•7/5/23, 4:36 PM

I've been there when working tickets, you have to look closely with Ray IDs

EErisa 😁 I've been there when working tickets, you have to look closely with Ray IDs

D

dave•7/5/23, 4:40 PM

can I filter by ray id here? (I know we've been over this before, my bad, I forgot.

)

E

ErisaOP•7/5/23, 4:40 PM

You can't, its sampled

E

ErisaOP•7/5/23, 4:40 PM

Only in Security > Events and logpush/logpull/etc.

D

dave•7/5/23, 4:47 PM

Ah right, so I should be seeing it in logpush..

D

dave•7/5/23, 4:47 PM

Is it possible for a

ParentRayID

ParentRayID

to come from a different Cloudflare account?

EErisa There is one but it only allows sending to pre-approved addresses <https://devel...

D

dave•7/5/23, 4:56 PM

Can you pre-approve an entire domain? (Pretty sure no, but sanity checking.)

E

ErisaOP•7/5/23, 4:57 PM

You cannot

Ddave Is it possible for a `ParentRayID` to come from a different Cloudflare account?

E

ErisaOP•7/5/23, 4:57 PM

I've never checked that, so cant tell you for sure immediately - I would guess not though

C

Caeden•7/5/23, 4:57 PM

Hi all! sorry to disturb does anyone know how to add a subdomain to a page like mydomain.co.za/jobs.html to jobs.mydomain.co.za? Its hosted on my webserver

EErisa I've never checked that, so cant tell you for sure immediately - I would guess n...

D

dave•7/5/23, 4:59 PM

hmm, I'm looking at one of my http logpush files and I don't see the parent ray ID in the same file as the ray ID itself.

C

Chaika•7/5/23, 5:03 PM

you could use a custom field for the cf-worker request header I believe as well, would work for worker requests from other accounts, although that would only give you zone

CChaika you could use a custom field for the cf-worker request header I believe as well,...

D

dave•7/5/23, 5:47 PM

yeah, I had that on already, sadly nothing showed up for it.

D

dave•7/5/23, 5:47 PM

  "RequestHeaders": {
    "sec-fetch-dest": "iframe",
    "sec-fetch-mode": "navigate",
    "sec-fetch-site": "cross-site"
  },

  "RequestHeaders": {
    "sec-fetch-dest": "iframe",
    "sec-fetch-mode": "navigate",
    "sec-fetch-site": "cross-site"
  },

  "RequestHeaders": {
    "sec-fetch-dest": "iframe",
    "sec-fetch-mode": "navigate",
    "sec-fetch-site": "cross-site"
  },

  "RequestHeaders": {
    "sec-fetch-dest": "iframe",
    "sec-fetch-mode": "navigate",
    "sec-fetch-site": "cross-site"
  },

C

Chaika•7/5/23, 5:50 PM

ah rip, I've noticed logpush is a bit weird as to where it runs in the flow. Adding request headers via transform rules doesn't allow them to be included as custom fields, only as response headers.

CChaika ah rip, I've noticed logpush is a bit weird as to where it runs in the flow. Add...

D

dave•7/5/23, 5:51 PM

ooo I think you're onto something with the transform rules

C

Chaika•7/5/23, 5:53 PM

doesn't look like cf.worker.upstream_zone is usable in transform rules

D

dave•7/5/23, 5:54 PM

dang it

D

dave•7/5/23, 8:48 PM

2023-07-05T20:48:10Z ERR failed to connect to origin error="websocket: bad handshake" originURL=https://asdf.example.com

2023-07-05T20:48:10Z ERR failed to connect to origin error="websocket: bad handshake" originURL=https://asdf.example.com

2023-07-05T20:48:10Z ERR failed to connect to origin error="websocket: bad handshake" originURL=https://asdf.example.com

2023-07-05T20:48:10Z ERR failed to connect to origin error="websocket: bad handshake" originURL=https://asdf.example.com

Is this because of a mismatch of cloudflared versions or something?

D

dave•7/5/23, 8:49 PM

dave@mbp odd % cloudflared --version
cloudflared version 2023.6.1 (built 2023-06-20T08:24:26Z)

dave@mbp odd % cloudflared --version
cloudflared version 2023.6.1 (built 2023-06-20T08:24:26Z)

dave@mbp odd % cloudflared --version
cloudflared version 2023.6.1 (built 2023-06-20T08:24:26Z)

dave@mbp odd % cloudflared --version
cloudflared version 2023.6.1 (built 2023-06-20T08:24:26Z)

Remote server is running 2023.3.1.

Ddave ``` dave@mbp odd % cloudflared --version cloudflared version 2023.6.1 (built 202...

C

Cyb3r-Jak3•7/5/23, 8:52 PM

That can happen for many reasons. Such as having web sockets disabled or binding cookie for the access policy

CCyb3r-Jak3 That can happen for many reasons. Such as having web sockets disabled or binding...

D

dave•7/5/23, 8:58 PM

any way to troubleshoot where the failure is?

Ddave any way to troubleshoot where the failure is?

C

Cyb3r-Jak3•7/5/23, 9:02 PM

Check that websockets are enabled and you have binding cookie off. Unfortunately there isn’t a good way to get logs from cloudflared for this, at least that I’ve found

CCyb3r-Jak3 Check that websockets are enabled and you have binding cookie off. Unfortunately...

D

dave•7/5/23, 9:03 PM

where are those options?

D

dave•7/5/23, 9:03 PM

this is for ssh for context

D

dave•7/5/23, 9:04 PM

ah fudge I see this is my fault

D

dave•7/5/23, 9:06 PM

yeah

D

dave•7/5/23, 9:06 PM

so a redirect rule broke it

D

dave•7/5/23, 9:18 PM

Why do redirect rules apply to tcp/ssh tunnels?

Ddave Why do redirect rules apply to tcp/ssh tunnels? 😅

C

Cyb3r-Jak3•7/5/23, 9:20 PM

If I remember correctly it’s because tunnels aren’t really TCP unless you use private networking. They are just TCP over websocket

D

dave•7/5/23, 9:22 PM

Is there a generic way/expression to avoid apply a ruleset to tunnels?

Original message was deleted

D

dave•7/5/23, 9:24 PM

yeah, agreed

C

Cyb3r-Jak3•7/5/23, 9:24 PM

Maybe go client and websocket if you can check if a request is a websocket

D

dave•7/5/23, 9:24 PM

hmm, or maybe just all websockets?

M

McSneaky•7/5/23, 9:39 PM

Is it possible to have callback / event from Cloudflare when certain asset is exired in CDN or deleted from cache?
I want to make websocket connection with durable object that's sending live events to client when asset expires so client can know to reload it

MMcSneaky Is it possible to have callback / event from Cloudflare when certain asset is ex...

D

dave•7/5/23, 9:40 PM

afaik no but I would love that.

M

McSneaky•7/5/23, 9:43 PM

Daymn

Then I'll just have to assume it's going to be deleted about 10s after I send delete request

M

McSneaky•7/5/23, 9:45 PM

Aah, I'll just disable cache for given asset

Then there's no need to wait

M

McSneaky•7/5/23, 9:46 PM

Works for demo.. Won't work for production

M

McSneaky•7/5/23, 9:47 PM

...
As workaround. There's log stream. Are "asset x has been deleted" in logs? Or only requests are?

S

Smarter•7/5/23, 9:47 PM

Was hoping someone could clear something up for me quick.

S

Smarter•7/5/23, 9:48 PM

I have

cloudflared

cloudflared

running inside a docker container, and currently my tunnel is connected and working with 1 instance of that container, the connector shows in the Dashboard.. If I scale that container out, what will happen to the requests coming to the Tunnel, how will they be routed to the multiple connected connectors...

MMcSneaky ... As workaround. There's log stream. Are "asset x has been deleted" in logs? O...

D

dave•7/5/23, 9:55 PM

you'll see if a cache miss happened in the log stream

MMcSneaky ... As workaround. There's log stream. Are "asset x has been deleted" in logs? O...

D

dave•7/5/23, 9:56 PM

copy pasted from a private channel (my own message/answer to be clear lol).

re: Cache API analytics: You can see Cache API events in logpush HTTP. e.g.:

{
  "ClientRequestSource": "edgeWorkerCacheAPI",
  "ClientIP": "2a06:98c0:3600::103",
  "ClientRequestHost": "ai.moda.invalid",
  "ClientRequestMethod": "PUT",
  "ClientRequestURI": "/get_products/1e347d6d6f008724dcc72f5b6b576c1ef6a6bd6c25443a54ee39041df34ed70eae435cc5f261655414bfa08ef50f4296dd3b13c82546136ba81e73ef4c275f70",
  "EdgeEndTimestamp": "2023-06-27T17:18:21Z",
  "EdgeResponseBytes": 355,
  "EdgeResponseStatus": 204,
  "EdgeStartTimestamp": "2023-06-27T17:18:21Z",
  "RayID": "7ddf5946a1ea006d",
  "WorkerCPUTime": 0,
  "WorkerStatus": "unknown",
  "WorkerSubrequest": true,
  "WorkerSubrequestCount": 0,
  "WorkerWallTimeUs": 0,
  "ZoneName": "ai.moda"
}

{
  "ClientRequestSource": "edgeWorkerCacheAPI",
  "ClientIP": "2a06:98c0:3600::103",
  "ClientRequestHost": "ai.moda.invalid",
  "ClientRequestMethod": "PUT",
  "ClientRequestURI": "/get_products/1e347d6d6f008724dcc72f5b6b576c1ef6a6bd6c25443a54ee39041df34ed70eae435cc5f261655414bfa08ef50f4296dd3b13c82546136ba81e73ef4c275f70",
  "EdgeEndTimestamp": "2023-06-27T17:18:21Z",
  "EdgeResponseBytes": 355,
  "EdgeResponseStatus": 204,
  "EdgeStartTimestamp": "2023-06-27T17:18:21Z",
  "RayID": "7ddf5946a1ea006d",
  "WorkerCPUTime": 0,
  "WorkerStatus": "unknown",
  "WorkerSubrequest": true,
  "WorkerSubrequestCount": 0,
  "WorkerWallTimeUs": 0,
  "ZoneName": "ai.moda"
}

{
  "ClientRequestSource": "edgeWorkerCacheAPI",
  "ClientIP": "2a06:98c0:3600::103",
  "ClientRequestHost": "ai.moda.invalid",
  "ClientRequestMethod": "PUT",
  "ClientRequestURI": "/get_products/1e347d6d6f008724dcc72f5b6b576c1ef6a6bd6c25443a54ee39041df34ed70eae435cc5f261655414bfa08ef50f4296dd3b13c82546136ba81e73ef4c275f70",
  "EdgeEndTimestamp": "2023-06-27T17:18:21Z",
  "EdgeResponseBytes": 355,
  "EdgeResponseStatus": 204,
  "EdgeStartTimestamp": "2023-06-27T17:18:21Z",
  "RayID": "7ddf5946a1ea006d",
  "WorkerCPUTime": 0,
  "WorkerStatus": "unknown",
  "WorkerSubrequest": true,
  "WorkerSubrequestCount": 0,
  "WorkerWallTimeUs": 0,
  "ZoneName": "ai.moda"
}

{
  "ClientRequestSource": "edgeWorkerCacheAPI",
  "ClientIP": "2a06:98c0:3600::103",
  "ClientRequestHost": "ai.moda.invalid",
  "ClientRequestMethod": "PUT",
  "ClientRequestURI": "/get_products/1e347d6d6f008724dcc72f5b6b576c1ef6a6bd6c25443a54ee39041df34ed70eae435cc5f261655414bfa08ef50f4296dd3b13c82546136ba81e73ef4c275f70",
  "EdgeEndTimestamp": "2023-06-27T17:18:21Z",
  "EdgeResponseBytes": 355,
  "EdgeResponseStatus": 204,
  "EdgeStartTimestamp": "2023-06-27T17:18:21Z",
  "RayID": "7ddf5946a1ea006d",
  "WorkerCPUTime": 0,
  "WorkerStatus": "unknown",
  "WorkerSubrequest": true,
  "WorkerSubrequestCount": 0,
  "WorkerWallTimeUs": 0,
  "ZoneName": "ai.moda"
}

https://developers.cloudflare.com/logs/reference/clientrequestsource/

In a reallllly roundabout way you could probably make passthrough Worker that acts as an S3 endpoint, and then use the Workers Analytics Engine to log

ClientRequestSource

ClientRequestSource

.

Ddave you'll see if a cache miss happened in the log stream

M

McSneaky•7/5/23, 10:02 PM

Yeah, was thinking about that too, but that assumes I'm doing requests

Ddave copy pasted from a private channel (my own message/answer to be clear lol). re:...

M

McSneaky•7/5/23, 10:03 PM

Tried that one too, but it's like they say in docs. Deleting cached asset may take up to 20sec. And if I refresh instantly after cache clear request has recieved, assets will still be cached
If I wait 10s, then it's 50/50. Sometimes still have to wait 20s for all assets to actually be cleared from cache

MMcSneaky Tried that one too, but it's like they say in docs. Deleting cached asset may ta...

D

dave•7/5/23, 10:04 PM

https://gist.github.com/Manouchehri/8db5ebcecbbc6b286ef226cb57122b1d

Gist

delete_from_cache_globally.ts

GitHub Gist: instantly share code, notes, and snippets.

M

McSneaky•7/5/23, 10:05 PM

But cache clearing isn't instant

So refresh happens before actual cache clearing

I know theres `ParentRayID` which points you to the request that triggered it

Similar Threads

Similar Threads

Similar Threads