I believe the API is only used for uploads and not serving images

CCyb3r-Jak3 I believe the API is only used for uploads and not serving images

D

dax•8/27/23, 3:29 AM

I'm hoping that's the case :/ Although there's also the scaling concern on uploads on peak hours. 1200 requests per 5 minutes isn't a lot. Not to mention this limit being in the same bucket as all other Cloudflare API calls

D

dax•8/27/23, 3:32 AM

I see a previous post saying if you upgrade to enterprise (spend 2k+ a month), you can raise this to 9999 per 5 minutes, which is still very low for modern day applications with >50K monthly active users

D

dax•8/27/23, 4:06 AM

Created a post on the forums in case anyone has a similar question later on: https://community.cloudflare.com/t/cloudflare-global-rate-limit-concerns/549583

Seems a bit silly if user generated traffic (uploads) can prevent us from even touching our data plane since they share the same API limits.

U

Unsmart•8/27/23, 4:11 AM

You can technically use multiple users each with their own auth tokens to increase the limit that way but yeah generally avoiding the API is best. Using R2 to store and serve images would probably be better

D

dax•8/27/23, 4:12 AM

Does r2 uploads get aggregated into a separate rate limit?

U

Unsmart•8/27/23, 4:13 AM

theres no rate limits for r2 uploads

D

dax•8/27/23, 4:13 AM

multiple users each with their own auth tokens

multiple users each with their own auth tokens

multiple users each with their own auth tokens

multiple users each with their own auth tokens

Ah I thought the 1200 req per 5 minutes was global for the account

D

dax•8/27/23, 4:13 AM

so it's per/user?

U

Unsmart•8/27/23, 4:13 AM

I mean at least in theory theres no rate limit on r2 eventually you might hit bucket scaling problems but

U

Unsmart•8/27/23, 4:14 AM

Its per cloudflare user. API tokens are tied to a specific cloudflare user and each user has their own limit

D

dax•8/27/23, 4:14 AM

Interesting. We might just shard our workers into using a pool of accounts upon startup to overcome that limit lol

U

Unsmart•8/27/23, 4:14 AM

you can invite as many users to your cf account as you want not sure if they have any limits on that (if they do it should be pretty high afaik)

D

dax•8/27/23, 4:14 AM

good to know - thanks!

D

Daniel Sincere•8/27/23, 4:18 AM

If I have a

CNAME

CNAME

pointing to a Cloudflare tunnel (Tunnel A), when I update the

CNAME

CNAME

to point to a second Cloudflare tunnel (Tunnel B), how long will it take for traffic to go to Tunnel B?

D

Daniel Sincere•8/27/23, 4:19 AM

Or to ask the question a different way, after updating the

CNAME

CNAME

to point to Tunnel B, how soon can I delete Tunnel A?

D

Daniel Sincere•8/27/23, 4:20 AM

I hope it's fairly quickly - less than a minute?

DDaniel Sincere If I have a `CNAME` pointing to a Cloudflare tunnel (Tunnel A), when I update th...

D

Dubz•8/27/23, 4:30 AM

I think a minute is Cloudflare's TTL for DNS, but it may be different (faster) for internal routing to update. I wouldn't rely on it heavily for automation purposes, but for an outage/recovery or migration, should go unnoticed by most.

D

Dubz•8/27/23, 4:31 AM

TTL for public DNS I mean, not internal routing

D

Daniel Sincere•8/27/23, 4:31 AM

yeah, doing a migration -

DDubz TTL for public DNS I mean, not internal routing

D

Daniel Sincere•8/27/23, 4:31 AM

not sure how to parse your first message in light of this correction?

D

Dubz•8/27/23, 4:32 AM

what?

D

Dubz•8/27/23, 4:33 AM

migration, you shouldn't really notice. It should be maybe a minute tops to propogate if I had to guess. In other words, unless you're doing this via automation, it'll probably be fast enough to stay ahead of you (unless you're trying to speed through it for some reason).

D

Dubz•8/27/23, 4:34 AM

Like a minute is not long at all

D

Daniel Sincere•8/27/23, 4:34 AM

ah gotcha

D

Daniel Sincere•8/27/23, 4:34 AM

thanks so much @Dubz (pls ping/reply) !

DDubz I think a minute is Cloudflare's TTL for DNS, but it may be different (faster) f...

D

Daniel Sincere•8/27/23, 5:32 AM

Can a Cloudflare tunnel have multiple endpoints? Can I run

cloudflared

cloudflared

on two separate clusters?

DDaniel Sincere Can a Cloudflare tunnel have multiple endpoints? Can I run `cloudflared` on two ...

D

Dubz•8/27/23, 5:35 AM

Yes, that's what you're supposed to do. redundancy

DDubz Yes, that's what you're supposed to do. redundancy

D

Daniel Sincere•8/27/23, 5:36 AM

Oh, so that might be another way to migrate traffic from one cluster to another!

D

Dubz•8/27/23, 5:37 AM

if the tunnel host is changing absolutely. If the target is changing, not really how that works

D

Dubz•8/27/23, 5:38 AM

it's for load balancing/redundancy basically. So if one tunnel breaks, the other can still serve. The service itself is either ran locally on that machine (like a CDN maybe) or all points to one main server they can access across either

DDubz it's for load balancing/redundancy basically. So if one tunnel breaks, the other...

D

Daniel Sincere•8/27/23, 5:51 AM

if one tunnel breaks

Just want to make sure I understand

In Cloudflare DNS, I'll have

CNAME api.example.com dead-beef.cfargotunnel.com

CNAME api.example.com dead-beef.cfargotunnel.com

and then I'll have

cloudflared

cloudflared

running on cluster 1, and

cloudflared

cloudflared

running on cluster 2, using the same tunnel credentials. So the tunnel is load-balanced between cluster 1 and cluster 2?

D

Dubz•8/27/23, 5:56 AM

yes...

DDaniel Sincere > if one tunnel breaks Just want to make sure I understand In Cloudflare DNS, I...

D

Dubz•8/27/23, 5:57 AM

https://developers.cloudflare.com/cloudflare-one/connections/connect-networks/install-and-setup/tunnel-useful-terms/#replica

Useful terms · Cloudflare Zero Trust docs

New! Set up and manage your Cloudflare Tunnel environment in Zero Trust. You will be able to install cloudflared as a service, create and run tunnels, …

DDubz https://developers.cloudflare.com/cloudflare-one/connections/connect-networks/in...

D

Daniel Sincere•8/27/23, 6:06 AM

Thank you!

B

Bjarn•8/27/23, 9:12 AM

Hi, it’s been over 36 hours with no reply on my ticket, even after this thread. I just tried spinning up a VM on Vultr

Issues still occurred around 2AM.

B

Bjarn•8/27/23, 9:15 AM

Also tweeted about it and got a reply from a stranger experiencing the same issues.

K

kian•8/27/23, 9:16 AM

I’d expect it to be looked at on Monday/Tuesday personally

B

Bjarn•8/27/23, 9:22 AM

Oh, alright. It’s been quiet compared to Friday night and Saturday morning/afternoon so it’s okay.
But what should I do next time? As this has been reproduced by multiple people and seriously was an issue somewhere along the route to or with Cloudflare impacting performance

B

Bjarn•8/27/23, 9:23 AM

It even impacted Pages and R2 being slow or even unavailable for some time

BBjarn Hi, it’s been over 36 hours with no reply on my ticket, even after this thread. ...

E

Erisa•8/27/23, 11:56 AM

I asked a colleague to look at it last night and they said they'd give it a second look today. If nothing happens by Monday then I'll take a look myself since I'm not working this weekend

E

Erisa•8/27/23, 11:58 AM

One thing that would help a lot is an mtr from an affected client

EErisa I asked a colleague to look at it last night and they said they'd give it a seco...

B

Bjarn•8/27/23, 12:05 PM

Ahh thanks

And no worries at all!

B

Bjarn•8/27/23, 12:05 PM

There's indeed 2 MTRs attached from both Digitalocean and Vultr

E

Erisa•8/27/23, 12:05 PM

Thanks

B

Bjarn•8/27/23, 12:18 PM

Appreciate the time and help - just got a bit stressed friday evening/yesterday due to complaining users

V

VoidableMoon884•8/27/23, 3:19 PM

?tunnel-tcp

F

Flare•8/27/23, 3:19 PM

Cloudflare Tunnels use Cloudflare's proxy, which only supports proxying HTTP Traffic. If you want to use non-http applications over your tunnel, Cloudflare has a few other options:

For a few specific protocols such as SSH, RDP, and SMB, Cloudflare has guides for them here:
https://developers.cloudflare.com/cloudflare-one/applications/non-http/

For Arbitrary TCP like Minecraft, MySQL, and any other tcp application, Cloudflare has a guide here: https://developers.cloudflare.com/cloudflare-one/applications/non-http/arbitrary-tcp/

For Arbitrary UDP like Minecraft Bedrock, SMTP, and any other udp application, you will need to use Private Networking with WARP: https://developers.cloudflare.com/cloudflare-one/connections/connect-apps/private-net/connect-private-networks/

Please note for all of these except SSH and VNC which can be browser-rendered, you will either need to use cloudflared (Cloudflare's tunnel daemon) on the client machine running in the background or Private Networking with WARP, and have WARP installed on the client machine logged into your Zero Trust Team.

I

Isaac McFadyen•8/27/23, 11:41 PM

?tunnel-tcp

F

Flare•8/27/23, 11:41 PM

Cloudflare Tunnels use Cloudflare's proxy, which only supports proxying HTTP Traffic. If you want to use non-http applications over your tunnel, Cloudflare has a few other options:

For a few specific protocols such as SSH, RDP, and SMB, Cloudflare has guides for them here:
https://developers.cloudflare.com/cloudflare-one/applications/non-http/

For Arbitrary TCP like Minecraft, MySQL, and any other tcp application, Cloudflare has a guide here: https://developers.cloudflare.com/cloudflare-one/applications/non-http/arbitrary-tcp/

For Arbitrary UDP like Minecraft Bedrock, SMTP, and any other udp application, you will need to use Private Networking with WARP: https://developers.cloudflare.com/cloudflare-one/connections/connect-apps/private-net/connect-private-networks/

Please note for all of these except SSH and VNC which can be browser-rendered, you will either need to use cloudflared (Cloudflare's tunnel daemon) on the client machine running in the background or Private Networking with WARP, and have WARP installed on the client machine logged into your Zero Trust Team.

I believe the API is only used for uploads and not serving images

Similar Threads

Similar Threads

Similar Threads