Just out of curiosity, how are you generating 25k files?! Images? Actual pages?

Iitsmatteomanf Just out of curiosity, how are you generating 25k files?! Images? Actual pages?

Hugo static site generator.
I have 700 articles, each with multiple images, every image has multiple optimized versions and sizes, every category and tag also produces another page as well, then include multiple json, xml, js, etc files and you hit the 25k limit really quickly.
I've been past it on my main website for some time I'm at more like 200k files now. I only use cloudflare pages now for some of the translations that have fewer pages and files. But I'm starting to reach the limit on those as well.

Ssimeononsecurity Hugo static site generator. I have 700 articles, each with multiple images, eve...

itsmatteomanfOP•12/4/23, 10:16 PM

One idea would be moving images to Cloudflare Images, but also at that volume it'd be probably better to the SSR route...

itsmatteomanfOP•12/4/23, 10:16 PM

How many of those pages are actually getting hit on average?

Iitsmatteomanf How many of those pages are actually getting hit on average?

simeononsecurity•12/4/23, 10:18 PM

It's not like I run a crazy popular website.
But I'm not doing anything crazy either. I'm just implementing the best practices that everyone should be doing on their websites.
Cloudflare images is an insane cost and isn't worth it for any site IMO. It takes two seconds to convert it to better formats. And it's a repeated cost for something that is only needed to be done once per image.
Each of my articles average 50-100 views per month. So not crazy. But definitely not enough to justify incredible costs.

Ssimeononsecurity It's not like I run a crazy popular website. But I'm not doing anything crazy e...

itsmatteomanfOP•12/4/23, 10:19 PM

But also not too bad for numbers... Image prices isn't ideal.

itsmatteomanfOP•12/4/23, 10:19 PM

R2 wouldn't be too bad, in this case

itsmatteomanfOP•12/4/23, 10:20 PM

But headers and such is not the best.

simeononsecurity•12/4/23, 10:21 PM

Looks like I've got some reading to do.
But it's incredible.
Everyone recommends static site generators and to use netlify or pages or whatever. But they just don't scale at all and you have no options other than to just "get good" and spend money like it's going out of style.
I see why everyone eventually goes to self-hosted and/or on-prem. These solutions just don't scale.
Only recommend for simple and throwaway sites.

werwerwe.•12/5/23, 3:03 AM

anyone has tried to deploy pages with more than 20000 files, in my case not problem with images just too many posts for a massive web site, I asked for a increase in the limits but not sure how long it will take., I've read your comments @simeononsecurity what will you do? will switch to another platform.

Wwerwerwe.anyone has tried to deploy pages with more than 20000 files, in my case not prob...

Cyb3r-Jak3•12/5/23, 3:12 AM

?channel-crossposting

Flare•12/5/23, 3:12 AM

Please do not post your question in multiple channels per the rules at No Access. It creates confusion for people trying to help you and doesn't get your issue or question solved any faster.

Wwerwerwe.anyone has tried to deploy pages with more than 20000 files, in my case not prob...

simeononsecurity•12/5/23, 3:12 AM

I'm either switching fully to netlify and just have to eat the long deployment times and cost.
Or go to render.
I'm in talks with them now.

EErisa Going higher than this would require an Enterprise plan and all Enterprise prici...

ty•12/5/23, 7:15 AM

epic thanks

0xdhrv•12/5/23, 7:42 AM

With pages, if I upload static HTML, does each update to the HTML count as a build?

Ssimeononsecurity Hugo static site generator. I have 700 articles, each with multiple images, eve...

JustinNoel•12/5/23, 10:06 AM

Consider SSR? it's pretty easy with Hono. https://hono.dev

You could have your content in a CMS or KV or D1.

Hono is a small, simple, and ultrafast web framework for the Edges. It works on Cloudflare Workers, Fastly Compute, Deno, Bun, Vercel, Netlify, Lagon, AWS Lambda, Lambda@Edge, and Node.js. Fast, but not only fast.

00xdhrv With pages, if I upload static HTML, does each update to the HTML count as a bui...

수

수린 arodi007•12/5/23, 10:20 AM

i believe each time you hit the button/cmd deploy will count +1

Constantin•12/5/23, 4:15 PM

i'm trying to add a custom domain for pages. but the Name is missing for the form

CConstantin i'm trying to add a custom domain for pages. but the Name is missing for the for...

Chaika•12/5/23, 4:18 PM

Seems to think that domain is external/not in your CF account (or maybe just not active?)

Constantin•12/5/23, 4:19 PM

it's internal (managed in the same cf account where pages live)

Constantin•12/5/23, 4:20 PM

now A is pointing to a different ip however

Chaika•12/5/23, 4:20 PM

A while ago it used to get confused if it was in two accounts/you had just moved it

Chaika•12/5/23, 4:21 PM

oh is that just the screen you're looking at after you added it? opps

Chaika•12/5/23, 4:22 PM

Either you changed the CNAME it added for you, or it did just get confused. You could manually change the DNS Record, delete the current one and add CNAMECNAME

TargetTarget ProxiedProxied, or delete the current Custom domain and readd it and it should be able to change it for you

Chaika•12/5/23, 4:29 PM

Nice, looks like it's working now. Out of caution, did you change it or did it just never adjust it? Sometimes people use third party integrations like Ezotic which can override changes and confuse people

AA•12/5/23, 6:13 PM

is there a way i can set my 'custom domains' so that some are pointing to the latest prod, and some to the latest dev?

AA•12/5/23, 6:13 PM

auth.foo.com to prod, and auth-d.foo.com to the latest preview build?

AAA is there a way i can set my 'custom domains' so that some are pointing to the la...

Chaika•12/5/23, 6:22 PM

As long as you are using CF DNS yea https://developers.cloudflare.com/pages/how-to/custom-branch-aliases/

Add a custom domain to a branch · Cloudflare Pages docs

In this guide, you will learn how to add a custom domain (staging.example.com) that will point to a specific branch (staging) on your Pages project.

CChaika As long as you are using CF DNS yea https://developers.cloudflare.com/pages/how-...

AA•12/5/23, 6:24 PM

just prefix 'staging.' to the dns record?

AA•12/5/23, 6:25 PM

dns target

Chaika•12/5/23, 6:25 PM

yes

AA•12/5/23, 7:06 PM

nice

works like a charm

h4rl•12/5/23, 10:38 PM

Hello, still needing assistance on pages-help"An unknown error occured." when setting a .みんな domain as a custom page domain. wondering if I may get help on it :)

James•12/6/23, 3:14 AM

Good day! First time Cloudflare Pages user here!

Is there a way to replace "npm clean-install" with "npm install --legacy-peer-deps"?

Bryce Wray•12/6/23, 3:07 PM

Question about using a _headers_headers file with a Pages project: does it support regex? For example, would the following work?

/(.*).(ac3|avi|bmp|br|bz2|css|cue|dat|doc|docx|dts|eot|exe|flv|gif|gz|ico|img|iso|jpeg|jpg|js|json|map|mkv|mp3|mp4|mpeg|mpg|ogg|pdf|png|ppt|pptx|qt|rar|rm|svg|swf|tar|tgz|ttf|txt|wav|webp|webm|webmanifest|woff|woff2|xls|xlsx|xml|zip)
    Cache-Control: public, max-age=31536000, immutable
    CDN-Cache-Control: public, max-age=31536000, immutable
    X-Content-Type-Options: nosniff

/(.*).(ac3|avi|bmp|br|bz2|css|cue|dat|doc|docx|dts|eot|exe|flv|gif|gz|ico|img|iso|jpeg|jpg|js|json|map|mkv|mp3|mp4|mpeg|mpg|ogg|pdf|png|ppt|pptx|qt|rar|rm|svg|swf|tar|tgz|ttf|txt|wav|webp|webm|webmanifest|woff|woff2|xls|xlsx|xml|zip)
    Cache-Control: public, max-age=31536000, immutable
    CDN-Cache-Control: public, max-age=31536000, immutable
    X-Content-Type-Options: nosniff

I currently use a Worker for this, but after one of my posts went semi-viral yesterday and blew through my monthly limit, am wondering whether I’m better off doing it through _headers_headers if that's possible.

Note: There’s no space between (.*).(.*). and (ac3|(ac3| , above; it just looks that way because of how the long line broke in this view.

(Also asked on the Discourse forum at https://community.cloudflare.com/t/regex-in-a-pages-headers-file/588889 — where I was advised that the answer is “No.” Just noting here for the record.)

Rrenzor is pages compatible with wrangler.toml?

Hello, I’m Allie!•12/6/23, 5:41 PM

Only in local development, and that is a bug

Ionic_Bonds•12/6/23, 8:35 PM

Has anyone experienced an issue where page will not actually manifest a working site when you upload a zip folder? Im wondering if it is because I have multiple folder within and am trying to essentially make it act as a fully fledged website rather than a dev site.