Do you see requests in the tail logs for the Worker?

Bbun im eating spaghetti with mushrooms right now its delicious

F

F0rce•2/23/24, 4:20 PM

im jealous xd

Bbun im eating spaghetti with mushrooms right now its delicious

H

Hello, I’m Allie!OP•2/23/24, 4:21 PM

Damn, making me hungry now…

HHello, I’m Allie!Do you see requests in the tail logs for the Worker?

F

F0rce•2/23/24, 4:21 PM

as I said, I tried that really long ago (proably 8+ months ago) and just wanted to ask before I go all in in that direction aswell. I can come back if I did some tests

HHello, I’m Allie!Damn, making me hungry now…

F

F0rce•2/23/24, 7:31 PM

sorry for pinging you / answering. But ive just spent time deploying everything (or making a good staging environment, with Zero Trust, etc -- the basics). But a request from dashboard.mydomain.com/ping to dashboard.mydomain.com/api/v1/ping does not work (it just returns 404 and the tail does not see the request registered). I dug a bit deeper and do I have to exclude / include a specific route in the _routes.json that is generated by astro?

Left backend (worker) right frontend (pages)

Bildschirmfoto_2024-02-23_um_20.31.16.png

F

F0rce•2/23/24, 7:32 PM

is there a way to explicity tell the page that some routes should NOT be handled by the page itself because something else is taking care of it (in that case the worker) ?

F

F0rce•2/23/24, 7:34 PM

when using

exlude: ["/api/*"]

exlude: ["/api/*"]

I get the following error from pages:

(log) TypeError: Fetch API cannot load: /api/v1/ping

(log) TypeError: Fetch API cannot load: /api/v1/ping

I'll try with absolute url

FF0rce sorry for pinging you / answering. But ive just spent time deploying everything ...

H

Hello, I’m Allie!OP•2/23/24, 7:38 PM

If the Worker is being called at all, then it should be called before Pages

F

F0rce•2/23/24, 7:38 PM

in the screenshot you can see that it is not called at all, because the pages tail has the api/v1/ping call

FF0rce in the screenshot you can see that it is not called at all, because the pages ta...

H

Hello, I’m Allie!OP•2/23/24, 7:39 PM

Yeah, so something else is happening. What is the route for your Worker?

F

F0rce•2/23/24, 7:39 PM

route = { pattern = "dashboard.ruxiom.dev/api/*", zone_name = "ruxiom.dev" }

route = { pattern = "dashboard.ruxiom.dev/api/*", zone_name = "ruxiom.dev" }

route = { pattern = "dashboard.ruxiom.dev/api/*", zone_name = "ruxiom.dev" }

route = { pattern = "dashboard.ruxiom.dev/api/*", zone_name = "ruxiom.dev" }

F

F0rce•2/23/24, 7:41 PM

and the Page has a custom domain pointing to

dashboard.ruxiom.dev

dashboard.ruxiom.dev

F

F0rce•2/23/24, 7:47 PM

absolute url with excluding does not work...

S

Simciutoja•2/23/24, 7:53 PM

0:23:57.383    Deploying your site to Cloudflare's global network...
20:24:00.014    Uploading... (0/26)
20:24:00.742    Uploading... (9/26)
20:24:00.898    Uploading... (17/26)
20:24:01.763    Uploading... (26/26)
20:24:01.763    ✨ Success! Uploaded 26 files (2.31 sec)
20:24:01.763    
20:24:02.295    ✨ Upload complete!
20:24:04.409    Success: Assets published!
20:24:05.495    Success: Your site was deployed!

0:23:57.383    Deploying your site to Cloudflare's global network...
20:24:00.014    Uploading... (0/26)
20:24:00.742    Uploading... (9/26)
20:24:00.898    Uploading... (17/26)
20:24:01.763    Uploading... (26/26)
20:24:01.763    ✨ Success! Uploaded 26 files (2.31 sec)
20:24:01.763    
20:24:02.295    ✨ Upload complete!
20:24:04.409    Success: Assets published!
20:24:05.495    Success: Your site was deployed!

0:23:57.383    Deploying your site to Cloudflare's global network...
20:24:00.014    Uploading... (0/26)
20:24:00.742    Uploading... (9/26)
20:24:00.898    Uploading... (17/26)
20:24:01.763    Uploading... (26/26)
20:24:01.763    ✨ Success! Uploaded 26 files (2.31 sec)
20:24:01.763    
20:24:02.295    ✨ Upload complete!
20:24:04.409    Success: Assets published!
20:24:05.495    Success: Your site was deployed!

0:23:57.383    Deploying your site to Cloudflare's global network...
20:24:00.014    Uploading... (0/26)
20:24:00.742    Uploading... (9/26)
20:24:00.898    Uploading... (17/26)
20:24:01.763    Uploading... (26/26)
20:24:01.763    ✨ Success! Uploaded 26 files (2.31 sec)
20:24:01.763    
20:24:02.295    ✨ Upload complete!
20:24:04.409    Success: Assets published!
20:24:05.495    Success: Your site was deployed!

S

Simciutoja•2/23/24, 7:54 PM

could someone help? I'v trying to upload strapi.

S

Simciutoja•2/23/24, 7:54 PM

on localhost its works but unfortunetly there not.

F

F0rce•2/23/24, 8:14 PM

the wierd thing is that a normal request (from bruno, local, or the browser itself) succeedes. only the sort of "subrequest" to an worker route from a cloudflare page is not working as expected (or by design)

F

F0rce•2/23/24, 9:00 PM

ok I was able to finally sort it out. But this seems like a super hacky workaround, there has to be a way to do without my current doings..... (worker sites had the exact use-case I am looking for right now).

Basically in Astro I created an

/api/[...request].js

/api/[...request].js

route (which is an api route) in my

pages

pages

folder.
The content is pretty simple:

export async function GET({ params }) {
  const backendRequest = await fetch(
    "https://dashboard.ruxiom.dev/api/" + params.request,
    {
      headers: {
        "CF-Access-Client-Id": "something.access",
        "CF-Access-Client-Secret":
          "something different",
      },
    }
  );

  return backendRequest.clone();
}

export async function GET({ params }) {
  const backendRequest = await fetch(
    "https://dashboard.ruxiom.dev/api/" + params.request,
    {
      headers: {
        "CF-Access-Client-Id": "something.access",
        "CF-Access-Client-Secret":
          "something different",
      },
    }
  );

  return backendRequest.clone();
}

export async function GET({ params }) {
  const backendRequest = await fetch(
    "https://dashboard.ruxiom.dev/api/" + params.request,
    {
      headers: {
        "CF-Access-Client-Id": "something.access",
        "CF-Access-Client-Secret":
          "something different",
      },
    }
  );

  return backendRequest.clone();
}

export async function GET({ params }) {
  const backendRequest = await fetch(
    "https://dashboard.ruxiom.dev/api/" + params.request,
    {
      headers: {
        "CF-Access-Client-Id": "something.access",
        "CF-Access-Client-Secret":
          "something different",
      },
    }
  );

  return backendRequest.clone();
}

As you can see I had to add an additional Service Auth Include Rule in our Zero Trust Dashboard, without it I get the error that I am not allowed to view that endpoint.

This seems absolutely ridicoulus, it really does...

F

F0rce•2/23/24, 9:00 PM

cc @Hello, I’m Allie!

F

F0rce•2/23/24, 9:05 PM

and in my Astro test page which should load some data from the backend it looks the following:

import "@/styles/globals.css";
import { cn } from "@/lib/utils";

let message = "Hello World";
try {
  const api = await fetch("https://dashboard.ruxiom.dev/api/v1/ping");
  message = await api.text();
} catch (error) {
  console.log(error);
  message = "Error or nothing found :(";
}

import "@/styles/globals.css";
import { cn } from "@/lib/utils";

let message = "Hello World";
try {
  const api = await fetch("https://dashboard.ruxiom.dev/api/v1/ping");
  message = await api.text();
} catch (error) {
  console.log(error);
  message = "Error or nothing found :(";
}

import "@/styles/globals.css";
import { cn } from "@/lib/utils";

let message = "Hello World";
try {
  const api = await fetch("https://dashboard.ruxiom.dev/api/v1/ping");
  message = await api.text();
} catch (error) {
  console.log(error);
  message = "Error or nothing found :(";
}

import "@/styles/globals.css";
import { cn } from "@/lib/utils";

let message = "Hello World";
try {
  const api = await fetch("https://dashboard.ruxiom.dev/api/v1/ping");
  message = await api.text();
} catch (error) {
  console.log(error);
  message = "Error or nothing found :(";
}

This is a cross-reference doing something twice loop-hole and I really dont think this is intentional behaviour........

F

F0rce•2/23/24, 9:08 PM

I just see the problem with invocations at the end... the page is invoced twice (once for the page and once for the "proxy" api call). The worker is invoced once (which is correct). But when making a lot of request to the backend to load some sort of data to display in the ui, thats where the invocation count will go up

F

F0rce•2/23/24, 9:21 PM

request to page --> pages calls internal api --> pages calls external api --> page loads

1

1million7393•2/24/24, 3:31 PM

hello, i deploy my website page on cloud flare page, but when i want input my sitemap on google search console it say error couln't fetch

1

1million7393•2/24/24, 3:31 PM

how to solve this problem?

FF0rce and in my Astro test page which should load some data from the backend it looks ...

F

F0rce•2/24/24, 7:05 PM

im still super lost here, any direction would be so much appreciated...

Bbinsarsempak hello guys where i can report abuse ?

C

Cyb3r-Jak3•2/25/24, 2:14 PM

?abuse

F

Flare•2/25/24, 2:14 PM

If you feel that a site is engaging in illegal or inappropriate activities, you can submit an abuse report at https://abuse.cloudflare.com/. The Trust and Safety team will review the details and reply if appropriate. You can also report the site to your relevant local authorities. Reports cannot be filed via Discord or with individual employees or Champs.

Kknutern Having some issues with added robots.txt for my CF page, deployed through github...

T

tcurdt•2/25/24, 10:19 PM

Did you find anything? I am having a similar issue.

T

tcurdt•2/25/24, 10:19 PM

For any error page it just shows

instead

T

tcurdt•2/25/24, 10:20 PM

And it does not even return my

robots.txt

robots.txt

on the

pages.dev

pages.dev

for some reason.

T

tcurdt•2/25/24, 10:23 PM

Hm ... but if it was caching it should return the previous version of the

robots.txt

robots.txt

. That's all a little weird.

T

tcurdt•2/25/24, 10:24 PM

 $ cat _site/robots.txt                                    
user-agent: *
disallow: /legal
disallow: /privacy
disallow: /cv
disallow: /links%                                                                                                                                   
$ curl https://site-torstencurdt-com.pages.dev/robots.txt
<html lang="en-US">
<head>

<meta charset="utf-8" />
<meta http-equiv="X-UA-Compatible" content="IE=edge" />
...

$ curl https://torstencurdt.com/robots.txt
<html lang="en-US">
<head>

<meta charset="utf-8" />
<meta http-equiv="X-UA-Compatible" content="IE=edge" />
...

 $ cat _site/robots.txt                                    
user-agent: *
disallow: /legal
disallow: /privacy
disallow: /cv
disallow: /links%                                                                                                                                   
$ curl https://site-torstencurdt-com.pages.dev/robots.txt
<html lang="en-US">
<head>

<meta charset="utf-8" />
<meta http-equiv="X-UA-Compatible" content="IE=edge" />
...

$ curl https://torstencurdt.com/robots.txt
<html lang="en-US">
<head>

<meta charset="utf-8" />
<meta http-equiv="X-UA-Compatible" content="IE=edge" />
...

 $ cat _site/robots.txt                                    
user-agent: *
disallow: /legal
disallow: /privacy
disallow: /cv
disallow: /links%                                                                                                                                   
$ curl https://site-torstencurdt-com.pages.dev/robots.txt
<html lang="en-US">
<head>

<meta charset="utf-8" />
<meta http-equiv="X-UA-Compatible" content="IE=edge" />
...

$ curl https://torstencurdt.com/robots.txt
<html lang="en-US">
<head>

<meta charset="utf-8" />
<meta http-equiv="X-UA-Compatible" content="IE=edge" />
...

 $ cat _site/robots.txt                                    
user-agent: *
disallow: /legal
disallow: /privacy
disallow: /cv
disallow: /links%                                                                                                                                   
$ curl https://site-torstencurdt-com.pages.dev/robots.txt
<html lang="en-US">
<head>

<meta charset="utf-8" />
<meta http-equiv="X-UA-Compatible" content="IE=edge" />
...

$ curl https://torstencurdt.com/robots.txt
<html lang="en-US">
<head>

<meta charset="utf-8" />
<meta http-equiv="X-UA-Compatible" content="IE=edge" />
...

T

tcurdt•2/25/24, 10:25 PM

not sure what I could be missing

T

tcurdt•2/25/24, 10:27 PM

I just switched to pages.
Before I had a typo and it was just

robot.txt

robot.txt

.
So the question is how would any caching come from?

T

tcurdt•2/25/24, 10:28 PM

Idea - maybe I purge the site cache. Just for fun.

T

tcurdt•2/25/24, 10:29 PM

Na, the purge didn't help.

T

tcurdt•2/25/24, 10:32 PM

it just keeps caching

T

tcurdt•2/25/24, 10:33 PM

that's when all this serverless stuff brings back the pain

T

tcurdt•2/25/24, 10:33 PM

well, I guess I'll check in a few hours again

T

tcurdt•2/25/24, 10:40 PM

It was just me being stupid

... robots.txt works now

T

tcurdt•2/25/24, 10:40 PM

but returning

for a 404 is not great

Do you see requests in the tail logs for the Worker?

Similar Threads

Similar Threads

Similar Threads