Hello, any idea why Cloudflare function has such strong limitations on `_routes.json` ? https://deve

Hello, any idea why Cloudflare function has such strong limitations on

_routes.json

_routes.json

? https://developers.cloudflare.com/pages/platform/functions/routing/#limits

Limits

You may have no more than 100 include/exclude rules combined.
Each rule may have no more than 100 characters.

For example, my team is using Astro (the framework) to generate a static site (SSG) and Astro is dumping routes such as:

{
  "version": 1,
  "include": [
    "/*"
  ],
  "exclude": [
    "/_astro/_slug_.48022e81.css",
    "/_astro/client.ee7b9fdd.js",
    "/articles/5-races-de-chiens-deconseillees-si-vous-n-avez-jamais-eu-de-chien-video/",
    "/articles/10-choses-amusantes-sur-les-chats-a-savoir-absolument/"
  ]
}

{
  "version": 1,
  "include": [
    "/*"
  ],
  "exclude": [
    "/_astro/_slug_.48022e81.css",
    "/_astro/client.ee7b9fdd.js",
    "/articles/5-races-de-chiens-deconseillees-si-vous-n-avez-jamais-eu-de-chien-video/",
    "/articles/10-choses-amusantes-sur-les-chats-a-savoir-absolument/"
  ]
}

{
  "version": 1,
  "include": [
    "/*"
  ],
  "exclude": [
    "/_astro/_slug_.48022e81.css",
    "/_astro/client.ee7b9fdd.js",
    "/articles/5-races-de-chiens-deconseillees-si-vous-n-avez-jamais-eu-de-chien-video/",
    "/articles/10-choses-amusantes-sur-les-chats-a-savoir-absolument/"
  ]
}

{
  "version": 1,
  "include": [
    "/*"
  ],
  "exclude": [
    "/_astro/_slug_.48022e81.css",
    "/_astro/client.ee7b9fdd.js",
    "/articles/5-races-de-chiens-deconseillees-si-vous-n-avez-jamais-eu-de-chien-video/",
    "/articles/10-choses-amusantes-sur-les-chats-a-savoir-absolument/"
  ]
}

The issue is that the Article slug is sometimes very long and we hit the 100 caracter limit (which is a very short limit for URI, but even wayyyy shorter for a complete path/url)

Also the

100 include/exclude rules combined

100 include/exclude rules combined

100 include/exclude rules combined

100 include/exclude rules combined would mean that our blog cannot contains more than 100 articles ?

Is astro using in the wrong way Cloudflare feautres or are those strong limits known among developpers using cloudflare ?

TTristan Hello, any idea why Cloudflare function has such strong limitations on `_routes....

DaniFoldi•8/17/23, 2:29 PM

There has been a recent improvement in the routes generation in astro, here is the PR: https://github.com/withastro/astro/pull/7846

you could try updating to that, or writing routes.json manually (not the best experience, I agree): you can remove everything from exclude, and only include routes or folders that need SSR, like
```
/api/*
```
```
/api/*
```

GitHub

more efficient _routes.json for cloudflare integration by schummar ...

Changes
Fixes #6516
The cloudflare integration tends to create large _routes.json files, which quickly hits the limit of 100 combined include/exclude entries that Cloudflare imposes even for small ...

DDaniFoldi There has been a recent improvement in the routes generation in astro, here is t...

TristanOP•8/17/23, 2:31 PM

Thank you !

TTristan Thank you !

DaniFoldi•8/17/23, 2:34 PM

No problem! Let me know if the new version improves things magically, or if you had to do manual changes afterwards

DDaniFoldi No problem! Let me know if the new version improves things magically, or if you ...

TristanOP•8/17/23, 4:01 PM

For now team has reverted back to SSR and dropped SSG. But if it changes I’ll let u know

Cretezy•8/18/23, 12:54 AM

Question about loading JSON:

We generate a small JSON file (1MB or so) during build time, and we'd like to load it at runtime for Functions.

Could we just

import

import

it? The docs say we can import binary data, but does that require a .bin.bin extension?

CCretezy Question about loading JSON: We generate a small JSON file (1MB or so) during b...

Hello, I’m Allie!•8/18/23, 8:31 AM

IIRC, JSON when imported is bundled as a JS object, so you shouldn’t need to make it binary instead

Noel•8/18/23, 1:10 PM

How does functions get built? I have a CRA project with craco and I'd like to do SSR to improve the first paint of my site, however when i import a component in functions i get errors about unknown loaders for svg, scss, etc. files so how should i configure my project to make this work?

Noel•8/18/23, 1:11 PM

I tried figuring it out by looking at flareact's source but I'm a bit lost

NNoel I tried figuring it out by looking at flareact's source but I'm a bit lost

Hello, I’m Allie!•8/18/23, 1:15 PM

Flareact is really old, and afaik doesn’t support Functions. For Functions setups, you might want to go with a framework that actively supports Functions/Pages deployments, like Next or Astro

Noel•8/18/23, 1:18 PM

yeah i didn't want to go with flareact either since it doesn't support react 18 and it seems like it only has SSR and not hybrid mode (?); i just wanted to get an idea how to do SSR in workers

Noel•8/18/23, 1:19 PM

i tried astro once but it didn't worked out

Noel•8/18/23, 1:20 PM

it suggested basically a seamless change, but after hours of refactoring i still wasn't able to get my page to work

Hello, I’m Allie!•8/18/23, 1:35 PM

Maybe try Next then? I know there has been some collab between the CRA team and Vercel, so it should be a bit easier to get working

Noel•8/18/23, 1:36 PM

after your first message i already started looking through the docs

HHello, I’m Allie!IIRC, JSON when imported is bundled as a JS object, so you shouldn’t need to mak...

Cretezy•8/18/23, 2:42 PM

Doesn't seem like it's possible to

import

import

JSON, am I missing something?

✘ [ERROR] Could not resolve "../builder/output.json"

src/api.ts:2:28:
2 │ import someJson from "../builder/output.json";

✘ [ERROR] Could not resolve "../builder/output.json"

src/api.ts:2:28:
2 │ import someJson from "../builder/output.json";

Have this file at functions/src/api.tsfunctions/src/api.ts with the JSON under functions/builder/output.jsonfunctions/builder/output.json

Cretezy•8/18/23, 2:42 PM

Also have resolveJsonModuleresolveJsonModule set for TypeScript

Unsmart•8/18/23, 3:33 PM

not yet

CCretezy Doesn't seem like it's possible to `import` JSON, am I missing something? ``` ✘...

Noel•8/18/23, 5:26 PM

but if the file gets generated during build then it doesn't exists when evaluating dependencies, does it?

Noel•8/18/23, 5:29 PM

so i guess you need some multi stage build where first the file is generated then it's used

Cretezy•8/18/23, 5:32 PM

It gets generated in the build command of the Pages, so it's present before it worker is compiled

Aanthony I am using D1 with Pages functions. Was working fine. My D1 database had a bindi...

Darg•8/18/23, 7:40 PM

I am having this issue as well on a new project. Name variable name (DBDB) turned into

__D1_BETA__DB

__D1_BETA__DB

. However in most cases I can't utilize either binding. Can anyone advise a path forward?

DDarg I am having this issue as well on a new project. Name variable name (`DB`) turne...

anthony•8/18/23, 8:07 PM

So weird. Are you seeing this behavior only in the deployed app as well?

Aanthony So weird. Are you seeing this behavior only in the deployed app as well?

Darg•8/18/23, 8:09 PM

Yeah. It is a Pages app, and I just found that the D1 binding works if I deploy via wrangler pages deploywrangler pages deploy instead of uploading via the dashboard. It's only an issue with D1 bindings as far as I know. I believe the KV binding works as expected in both cases

DDarg Yeah. It is a Pages app, and I just found that the D1 binding works if I deploy ...

Hello, I’m Allie!•8/18/23, 8:12 PM

Functions don’t work at all if you use dashboard direct uploads

HHello, I’m Allie!Functions don’t work at all if you use dashboard direct uploads

Darg•8/18/23, 8:13 PM

How were they working for me?

DDarg How were they working for me?

Hello, I’m Allie!•8/18/23, 8:14 PM

unless they added that recently, they shouldn’t be working

Hello, I’m Allie!•8/18/23, 8:15 PM

Were you doing it via Git?

Darg•8/18/23, 8:15 PM

Hello, I’m Allie!•8/18/23, 8:15 PM

Direct Uploads don’t run through a build, so something else must be happening…

Darg•8/18/23, 8:15 PM

The app is already built before I upload

DDarg The app is already built before I upload

Hello, I’m Allie!•8/18/23, 8:16 PM

Maybe that’s why D1 didn’t work, since it has to be run through Wrangler to work

Hello, I’m Allie!•8/18/23, 8:18 PM

Though there may be an update that removes the need for a shim

Hello, I’m Allie!•8/18/23, 8:18 PM

We do still recommend using Wrangler when using Functions though

Darg•8/18/23, 8:18 PM

I'm only talking about the deployed app here, not local development

Hello, I’m Allie!•8/18/23, 8:18 PM

D1 or not

DDarg I'm only talking about the deployed app here, not local development

Hello, I’m Allie!•8/18/23, 8:18 PM

No, I mean using wrangler pages deploy

Darg•8/18/23, 8:22 PM

Ok well when I upload via the web UI — which doesn't mention this limitation — I would get a KV binding and a binding to

__D1_BETA__DB

__D1_BETA__DB

which would sometimes be a D1 binding and sometimes an empty object

DDarg Ok well when I upload via the web UI — which doesn't mention this limitation — I...

Hello, I’m Allie!•8/18/23, 8:24 PM

IIRC, D1 Bindings, under the hood, are just a fetcher instance. When building with Wrangler, it will insert a shim that takes all the calls to env.D1, formats it a certain way, then passes it in to the Beta DB binding you found

Hello, I’m Allie!•8/18/23, 8:24 PM

So since you didn’t run wrangler to deploy it, it never inserts the shim, and thus D1 queries don’t work

HHello, I’m Allie!IIRC, D1 Bindings, under the hood, are just a fetcher instance. When building wi...

anthony•8/18/23, 8:27 PM

That's interesting, thanks. Will dig a bit deeper when i get the time into if I can reproduce both broken/correct state with something on my side

kian•8/19/23, 3:56 AM

You can't

JSON.stringify

JSON.stringify

a FormData object

kian•8/19/23, 3:57 AM

If you just want a quick idea of what's in it, try this instead:

const formData = await request.formData();
console.log(Object.fromEntries(formData))

const formData = await request.formData();
console.log(Object.fromEntries(formData))

borat8333•8/19/23, 4:56 AM

Hi. I have a Nuxt project with Git integration to deploy at Cloudflare Pages. I have no functions at all (no

/functions

/functions

) but I am getting the error:

Error: Failed to publish your Function. Got error: Uncaught TypeError: Cannot convert object to primitive value

Error: Failed to publish your Function. Got error: Uncaught TypeError: Cannot convert object to primitive value

I have no functions at all. Any help would be appreciated.

Bborat8333 Hi. I have a Nuxt project with Git integration to deploy at Cloudflare Pages. I ...

Dahoom•8/20/23, 2:16 AM

You might be trying to use SSR, SSR depends on functions to load the page

Dahoom•8/20/23, 2:16 AM

Without functions you would probably have to make it a static site for it to work

Hello, any idea why Cloudflare function has such strong limitations on `_routes.json` ? https://deve

Similar Threads