ok I was able to finally sort it out. But this seems like a super hacky workaround, there has to be

ok I was able to finally sort it out. But this seems like a super hacky workaround, there has to be a way to do without my current doings..... (worker sites had the exact use-case I am looking for right now).

Basically in Astro I created an

/api/[...request].js

/api/[...request].js

/api/[...request].js

/api/[...request].js route (which is an api route) in my

pages

pages

folder.
The content is pretty simple:

export async function GET({ params }) {
  const backendRequest = await fetch(
    "https://dashboard.ruxiom.dev/api/" + params.request,
    {
      headers: {
        "CF-Access-Client-Id": "something.access",
        "CF-Access-Client-Secret":
          "something different",
      },
    }
  );

  return backendRequest.clone();
}

export async function GET({ params }) {
  const backendRequest = await fetch(
    "https://dashboard.ruxiom.dev/api/" + params.request,
    {
      headers: {
        "CF-Access-Client-Id": "something.access",
        "CF-Access-Client-Secret":
          "something different",
      },
    }
  );

  return backendRequest.clone();
}

export async function GET({ params }) {
  const backendRequest = await fetch(
    "https://dashboard.ruxiom.dev/api/" + params.request,
    {
      headers: {
        "CF-Access-Client-Id": "something.access",
        "CF-Access-Client-Secret":
          "something different",
      },
    }
  );

  return backendRequest.clone();
}

export async function GET({ params }) {
  const backendRequest = await fetch(
    "https://dashboard.ruxiom.dev/api/" + params.request,
    {
      headers: {
        "CF-Access-Client-Id": "something.access",
        "CF-Access-Client-Secret":
          "something different",
      },
    }
  );

  return backendRequest.clone();
}

As you can see I had to add an additional Service Auth Include Rule in our Zero Trust Dashboard, without it I get the error that I am not allowed to view that endpoint.

This seems absolutely ridicoulus, it really does...

F0rceOP•2/23/24, 9:00 PM

cc @Hello, I’m Allie!

F0rceOP•2/23/24, 9:05 PM

and in my Astro test page which should load some data from the backend it looks the following:

import "@/styles/globals.css";
import { cn } from "@/lib/utils";

let message = "Hello World";
try {
  const api = await fetch("https://dashboard.ruxiom.dev/api/v1/ping");
  message = await api.text();
} catch (error) {
  console.log(error);
  message = "Error or nothing found :(";
}

import "@/styles/globals.css";
import { cn } from "@/lib/utils";

let message = "Hello World";
try {
  const api = await fetch("https://dashboard.ruxiom.dev/api/v1/ping");
  message = await api.text();
} catch (error) {
  console.log(error);
  message = "Error or nothing found :(";
}

This is a cross-reference doing something twice loop-hole and I really dont think this is intentional behaviour........

F0rceOP•2/23/24, 9:08 PM

I just see the problem with invocations at the end... the page is invoced twice (once for the page and once for the "proxy" api call). The worker is invoced once (which is correct). But when making a lot of request to the backend to load some sort of data to display in the ui, thats where the invocation count will go up

F0rceOP•2/23/24, 9:21 PM

request to page --> pages calls internal api --> pages calls external api --> page loads

1million7393•2/24/24, 3:31 PM

hello, i deploy my website page on cloud flare page, but when i want input my sitemap on google search console it say error couln't fetch

1million7393•2/24/24, 3:31 PM

how to solve this problem?

FF0rce and in my Astro test page which should load some data from the backend it looks ...

F0rceOP•2/24/24, 7:05 PM

im still super lost here, any direction would be so much appreciated...

Bbinsarsempak hello guys where i can report abuse ?

Cyb3r-Jak3•2/25/24, 2:14 PM

?abuse

Flare•2/25/24, 2:14 PM

If you feel that a site is engaging in illegal or inappropriate activities, you can submit an abuse report at https://abuse.cloudflare.com/. The Trust and Safety team will review the details and reply if appropriate. You can also report the site to your relevant local authorities. Reports cannot be filed via Discord or with individual employees or Champs.

Kknutern Having some issues with added robots.txt for my CF page, deployed through github...

tcurdt•2/25/24, 10:19 PM

Did you find anything? I am having a similar issue.

tcurdt•2/25/24, 10:19 PM

For any error page it just shows

instead

tcurdt•2/25/24, 10:20 PM

And it does not even return my robots.txtrobots.txt on the pages.devpages.dev for some reason.

tcurdt•2/25/24, 10:23 PM

Hm ... but if it was caching it should return the previous version of the robots.txtrobots.txt. That's all a little weird.

tcurdt•2/25/24, 10:24 PM

 $ cat _site/robots.txt                                    
user-agent: *
disallow: /legal
disallow: /privacy
disallow: /cv
disallow: /links%                                                                                                                                   
$ curl https://site-torstencurdt-com.pages.dev/robots.txt
<html lang="en-US">
<head>

<meta charset="utf-8" />
<meta http-equiv="X-UA-Compatible" content="IE=edge" />
...

$ curl https://torstencurdt.com/robots.txt
<html lang="en-US">
<head>

<meta charset="utf-8" />
<meta http-equiv="X-UA-Compatible" content="IE=edge" />
...

 $ cat _site/robots.txt                                    
user-agent: *
disallow: /legal
disallow: /privacy
disallow: /cv
disallow: /links%                                                                                                                                   
$ curl https://site-torstencurdt-com.pages.dev/robots.txt
<html lang="en-US">
<head>

<meta charset="utf-8" />
<meta http-equiv="X-UA-Compatible" content="IE=edge" />
...

$ curl https://torstencurdt.com/robots.txt
<html lang="en-US">
<head>

<meta charset="utf-8" />
<meta http-equiv="X-UA-Compatible" content="IE=edge" />
...

tcurdt•2/25/24, 10:25 PM

not sure what I could be missing

tcurdt•2/25/24, 10:27 PM

I just switched to pages.
Before I had a typo and it was just robot.txtrobot.txt.
So the question is how would any caching come from?

tcurdt•2/25/24, 10:28 PM

Idea - maybe I purge the site cache. Just for fun.

tcurdt•2/25/24, 10:29 PM

Na, the purge didn't help.

tcurdt•2/25/24, 10:32 PM

it just keeps caching

tcurdt•2/25/24, 10:33 PM

that's when all this serverless stuff brings back the pain

tcurdt•2/25/24, 10:33 PM

well, I guess I'll check in a few hours again

tcurdt•2/25/24, 10:40 PM

It was just me being stupid

... robots.txt works now

tcurdt•2/25/24, 10:40 PM

but returning

for a 404 is not great

tcurdt•2/25/24, 10:40 PM

and I didn't find where to change that yet

Walshy•2/25/24, 10:40 PM

https://developers.cloudflare.com/pages/configuration/serving-pages/#single-page-application-spa-rendering

Walshy•2/25/24, 10:41 PM

If your project does not include a top-level 404.html file, Pages assumes that you are deploying a single-page application. This includes frameworks like React, Vue, and Angular. Pages’ default single-page application behavior matches all incoming paths to the root (/)

Walshy•2/25/24, 10:47 PM

as for custom domain caching, that's independant of Pages' cache. Pages does not mess with your zone cache.

So, by default everything listed (https://developers.cloudflare.com/cache/concepts/default-cache-behavior/#default-cached-file-extensions) is cached for a while. Purging zone cache will clear it
Additionally, I'd recommend skipping cache for Pages projects and let Pages handle it

tcurdt•2/25/24, 10:49 PM

Absolutely not where I would have found it in the docs. Thanks for the pointer!

FF0rce ok I was able to finally sort it out. But this seems like a super hacky workarou...

F0rceOP•2/26/24, 1:02 PM

still stuck on this and cant get this out of my head...

Sunlight•2/26/24, 2:50 PM

I am using

nuxt

nuxt

and server side seo image generation. In very rare cases I catch the error Error 1102 - Worker exceeded resource limitsError 1102 - Worker exceeded resource limits. How can I be sure what is causing this error or how can I resize my worker resources?

zwily•2/26/24, 6:54 PM

anyone else's github -> cloudflare integration not working today?

zwily•2/26/24, 6:56 PM

well, never mind https://www.githubstatus.com

GitHub Status

Welcome to GitHub's home for real-time and historical data on system performance.

zwily•2/26/24, 7:14 PM

it's working again.

SupaHigh•2/26/24, 7:24 PM

Hello!! I just activate cloudflare on my domain and one page stopped working: https://share.cleanshot.com/TPxcJ3S1

CleanShot Cloud

CleanShot 2024-02-26 at 20.24.10

Screenshot uploaded to CleanShot Cloud

SupaHigh•2/26/24, 7:24 PM

can anybody tell me what is the cause of this?

Sly•2/26/24, 7:29 PM

How the heck do I get the pages action to build? It always tries to deploy yet seeming doesn’t have the files build beforehand available

SSly How the heck do I get the pages action to build? It always tries to deploy yet s...

Chaika•2/26/24, 8:07 PM

The pages Github Action is just used to do the uploading, like how wrangler pages deploy first. You have to build your application first in the Github Action/yml

Sly•2/26/24, 8:08 PM

That should happen and works locally :/

ok I was able to finally sort it out. But this seems like a super hacky workaround, there has to be

Similar Threads