Cloudflare Developers•2y ago

would love to implement this for browser use...any tips?

RRAGman would love to implement this for browser use...any tips?

Alex•3/26/24, 7:03 PM

StorJ offers that

Alex•3/26/24, 7:04 PM

storJ is absolutely stellar, except for speed

AAlex yes. but if it's not a zero-knowledge storage, you have absolutely no way to kno...

Isaac McFadyen•3/26/24, 7:06 PM

Yes, except that you can (and should) encrypt stored objects.

Isaac McFadyen•3/26/24, 7:07 PM

R2 does this automatically, as does GCS, but you can provide your own key on GCS.

Original message was deleted

Isaac McFadyen•3/26/24, 7:08 PM

You, if you upload your own keys at GetObject time.

Isaac McFadyen•3/26/24, 7:08 PM

Regardless, this probably isn't a very productive discussion :lul:

Isaac McFadyen•3/26/24, 7:09 PM

Cloudflare definitely does not inspect R2 objects. It's up to you to trust that, but given if it leaked that they'd be immediately sued by enterprise customers using R2 (and likely destroyed as a company) then it's pretty much a given that they don't

Isaac McFadyen•3/26/24, 7:09 PM

Of course, if you don't trust that then you don't need to use R2

Chaika•3/26/24, 7:10 PM

I can tell you without a doubt Cloudflare does not look at your GCS objects. Does that help?

MattIPv4•3/26/24, 7:12 PM

:oki: I hope you own multiple physical buildings then so you can keep redundant local backups of stuff if you're not using online services to store it

MattIPv4•3/26/24, 7:13 PM

Wonderful

MattIPv4•3/26/24, 7:13 PM

Also, given you're so worried about folks inspecting stuff, I should make you aware that you're using Discord currently, and they are absolutely feeding your messages into AI

MattIPv4•3/26/24, 7:14 PM

That it is

MattIPv4•3/26/24, 7:17 PM

Lab coat, ladder and high-vis, the three horsemen of getting into places you shouldn't be

MattIPv4•3/26/24, 7:17 PM

Anyway, I do fear this convo has veered rather off-topic for this channel

Alex•3/26/24, 8:42 PM

I'm not even sure that the problem is rate limiting here. this is the error that we get from the API

Alex•3/26/24, 8:42 PM

Remote Storage: Failed to upload listings/06-2020//**.webp with error: Error executing "PutObject" on "https://*************.eu.r2.cloudflarestorage.com/listings/06-2020/******/**********.webp"; AWS HTTP error: Server error: PUT https://**********.eu.r2.cloudflarestorage.com/listings/06-2020/******/***************.webp resulted in a 500 Internal Server Error response:
InternalErrorWe encountered an internal error. Please (truncated...) InternalError (server): We encountered an internal error. Please try again. - InternalErrorWe encountered an internal error. Please try again. on line# 981

Alex•3/26/24, 8:43 PM

what is it ?

AAlex 350-400 requests per second ?

bun•3/26/24, 8:44 PM

Ok wow this is incredibly slow

Alex•3/26/24, 8:44 PM

so how does one put millions of files in R2?

Alex•3/26/24, 8:46 PM

Can't do that. the application must use one bucket, it's how its designed.

bun•3/26/24, 8:46 PM

That doesnt make any sense for the devs to manage multiple buckets? Same goes for D1. Why are they limiting stuff and telling devs to shard/manage multiple stuff

Karew•3/26/24, 8:47 PM

Cloudflare isn’t saying to shard, it’s just one way to get around the problem currently

Alex•3/26/24, 8:47 PM

then it's a "bug" of R2.

Alex•3/26/24, 8:47 PM

bad implementation

bun•3/26/24, 8:47 PM

Oh so its just temporary software limitation

Karew•3/26/24, 8:48 PM

Can your app be slowed down or use a queue somehow for put requests?

bun•3/26/24, 8:48 PM

That doesn’t explain D1 though, 2 GB is incredibly low for a modern database

Alex•3/26/24, 8:48 PM

well yeah, we'll modify the migration application, but I keep seeing problems with R2. Cloudflare, please work on this product!

Karew•3/26/24, 8:49 PM

D1 is still in beta, but you should ask the D1 people in that channel

KKarew D1 is still in beta, but you should ask the D1 people in that channel

bun•3/26/24, 8:49 PM

From based on their responses they aren’t going to up the limit by a lot. Probably limit up to 10 GB, but its still incredibly low

bun•3/26/24, 8:50 PM

Thats my complaint about cloudflare, they rarely prioritize something? They legit have 100 things in beta

Bbun Thats my complaint about cloudflare, they rarely prioritize something? They legi...

Alex•3/26/24, 8:51 PM

exactly this. they launced 30 new services with mediocre level, instead of fewer services with top-notch level

Alex•3/26/24, 8:52 PM

for what's worth, I also tested cloudflare stream vs bunnyCDN stream, and bunny was faster and more consistent across all over europe.

Karew•3/26/24, 8:52 PM

I really like R2 but you are using a middle-tier file product and paying that price. If you need to critically be able to put thousands of objects per second you should probably shell out for Amazon S3

Alex•3/26/24, 8:53 PM

but its cloudflare. they are supposed to be innovative!

Alex•3/26/24, 8:55 PM

cloudflare's cdn is good

bun•3/26/24, 8:56 PM

Bunny?

bun•3/26/24, 8:57 PM

Its cheaper with bunny if you frequently use the storage as they dont charge for API fees

Alex•3/26/24, 8:57 PM

https://www.cdnperf.com/

CDNPerf - CDN Performance and Uptime monitoring, comparison and ana...

With CDNPerf you can find the fastest CDN provider in the world or just your country. Get the top CDN by using our data for free.

bun•3/26/24, 8:57 PM

they actually have a cdn on top of thr storage

bun•3/26/24, 8:57 PM

Unlike r2 which for some cloudflare cdn doesnt support

Karew•3/26/24, 8:58 PM

R2 does work with the CDN if you connect a domain

bun•3/26/24, 9:01 PM

They said they didnt wat

bun•3/26/24, 9:01 PM

Where?

Alex•3/26/24, 9:07 PM

bunny is no joke. There hasn’t been a single service I tested from them that wasn’t flawless. I once talked to the owner, that Pelzel guy. He said to be they work on a product for ages until they make it better than anyone. They optimize everything, even at protocol level

Alex•3/26/24, 9:08 PM

That’s why they are #1 on cdnperf

Alex•3/26/24, 9:08 PM

I’m using their stream service.

Alex•3/26/24, 9:09 PM

It’s not s3 compatible

Alex•3/26/24, 9:11 PM

You’re right

would love to implement this for browser use...any tips?

Similar Threads