Cloudflare Developers•3y ago

Maybe your home connection is slow and cannot handle opening too many videos at once.

Oomar4289 Maybe your home connection is slow and cannot handle opening too many videos at ...

flayks•10/29/23, 8:20 PM

nah I have fiber and 1gbps down with very low latency

Fflayks nah I have fiber and 1gbps down with very low latency

omar4289OP•10/29/23, 8:21 PM

Check your network tab and see how long it takes to download the files (When reading videos from r2, you will have to download all of the content before you can read it)

omar4289OP•10/29/23, 8:22 PM

If that is inconvenient (Which it is most of the time), then you will need to have it as a stream

flayks•10/29/23, 8:23 PM

well each video starts playing but then buffers so I feel this is coming from R2

Fflayks well each video starts playing but then buffers so I feel this is coming from R2

omar4289OP•10/29/23, 8:24 PM

Oh ok, what do you see in devtools?

flayks•10/29/23, 8:25 PM

sometimes a Pending state for a solid 10-20sc

omar4289OP•10/29/23, 8:26 PM

Ok, never tried to play multiple videos from r2, lets wait for an answer from the official r2 team, but from documentation, I could not see such limitations

Original message was deleted

kev-ac•10/29/23, 8:40 PM

No thats not possible. Out of interest: What would be your use case to limit the download speed intentionally?

Original message was deleted

omar4289OP•10/29/23, 8:42 PM

I think you should be able to using a worker with r2

omar4289OP•10/29/23, 8:42 PM

There are streaming api which you can control as you want, but not sure if all can be done within the time allocated to workers

Oomar4289 There are streaming api which you can control as you want, but not sure if all c...

kev-ac•10/29/23, 8:44 PM

That would be definitely a problem as workers are more likely to be evicated after 30(?) seconds

kev-ac•10/29/23, 8:45 PM

If you need to implement something like this a server-side solution might be your only choice.

Original message was deleted

kev-ac•10/29/23, 8:47 PM

Yes. This way, hypothetically, you have full control over the flow. Even a simple nginx proxy with the correct configuration would do the trick here.

omar4289OP•10/29/23, 8:47 PM

You will need to implement a range download. Ranges will be smaller for freemium users.

omar4289OP•10/29/23, 8:48 PM

Kind of like send chunks of 7kb per second for freemium users and unlimited for premium

Oomar4289 Kind of like send chunks of 7kb per second for freemium users and unlimited for ...

kev-ac•10/29/23, 8:51 PM

I can't follow you how a range request would be slower than a full file download. Yes there is some protocol overhead if the chunks are very small, but with http2 negligible. And the next thing would be: How do you want to enforce this? I'm unsure if you can specify a content-range when creating a presigned URL.

Original message was deleted

kev-ac•10/29/23, 8:54 PM

I mean: Just try it. If the rule is correct you'll be greeted with an error. This should work but don't rely on it for content protection. What this will prevent is hotlinking to the URL.

kev-ac•10/29/23, 8:56 PM

You should implement URL signing for downloads, especially if you have paying customers. Otherwise a known direct download link would be valid forever (until the file is removed from R2)

kev-ac•10/29/23, 8:56 PM

@101budspencer If you want to go deeper here maybe consider opening a thread so it doesn't spam the channel too much.

Original message was deleted

kev-ac•10/29/23, 8:59 PM

Yes. You'll find more here: https://developers.cloudflare.com/r2/api/s3/presigned-urls/

Presigned URLs · Cloudflare R2 docs

Presigned URLs are an S3 concept for sharing direct access to your bucket without revealing your token secret. A presigned URL authorizes anyone with …

Original message was deleted

kev-ac•10/29/23, 9:01 PM

Just access. Once the download is ongoing it will complete.

Erisa•10/29/23, 9:06 PM

if thats your website, check Security > Events on the dashboard to find out

kev-ac•10/29/23, 9:10 PM

Just had a look at your website. When clicking on download it will open a new tab with a scam download website.

Original message was deleted

kev-ac•10/29/23, 9:12 PM

I don't think its a good thing to cooperate with an ad network that shows "ads" like this. But thats your business / risk decision.

Kkev-ac I can't follow you how a range request would be slower than a full file download...

omar4289OP•10/29/23, 9:33 PM

Obviously there should be a rate limit as per ip (or id of the begining of the stream) and then you slow down the request backend wise. Something like (On first range return an id somewhere - could be headers) and all subsequent requests should include this id.
Backend wise, you can throttle your responses for a given id (or ip) and make sure you don't exceed the desired rate.
I know it does require some work, and no you cannot do it through a presigned url since the goal here is to reduce the speed of download (which assumes data is public with no presigned url needed)

Karew•10/29/23, 10:48 PM

Cloudflare Security Insights is still complaining about the TLS settings on R2 custom domains, would really be great if we had any control over that (or it would be great if Insights would just not open these alerts if it doesn't matter) blobcatneutral

Original message was deleted

omar4289OP•10/29/23, 10:58 PM

turns out you can do all of that within a worker

omar4289OP•10/29/23, 10:59 PM

Just tried it with an example and it did work fine for me. My image download takes a long time for free users, while it speeds up for paid users

omar4289OP•10/29/23, 10:59 PM

Not sure if that is relevent anymore

omar4289OP•10/29/23, 11:10 PM

@101budspencer , here is the code for download limiting

omar4289OP•10/29/23, 11:10 PM

omar4289OP•10/29/23, 11:14 PM

An example can be found here - will be disabled tomorrow night. Please guys do not spam it.
With slowdown: https://test-r2.easier-api.com/large-image.jpg
Without slowdown: https://test-r2.easier-api.com/large-image.jpg?token=my_token

omar4289OP•10/29/23, 11:18 PM

For info, I am running in the bundled mode and this is simply a worker in front of my r2

MMaurice hi guys, are any of you having issues with download/upload speeds? D:

omar4289OP•10/30/23, 6:10 AM

Now, how long does it take to complete the download?

omar4289OP•10/30/23, 7:06 AM

What are the numbers on y axis ?

Oomar4289 What are the numbers on y axis ?

omar4289OP•10/30/23, 7:06 AM

Never mind, was Bytes/s

omar4289OP•10/30/23, 7:09 AM

Did you run the tests:
1- From different machines/servers
2- With relatively large files
3- Multiple files download (1k and then run an average per computer)
4- Try a download from other servers, and check the difference between r2 download and other services (like s3 or google storage if you have an account with them)

starina_cool•10/30/23, 7:27 AM

Why Cache Reserve MISS results in Class A and B operation? R2 404 reads do not billed as class B operations as I know.

kian•10/30/23, 7:50 AM

They should be iirc

kian•10/30/23, 7:51 AM

Yeah, 404s are billable

Kkian Yeah, 404s are billable

omar4289OP•10/30/23, 8:00 AM

What is the billing rate for 404 requests ? Same as class B requests?

kian•10/30/23, 8:01 AM

It’s just a GetObject request as normal

AmySox•10/30/23, 8:03 AM

#Resumption?

Original message was deleted

omar4289OP•10/30/23, 8:20 AM

If you repeat the test on 81dd270dd8bd46d4-DFW, do you always get the same results with low speed?

Unbreathable•10/30/23, 8:54 AM

Hey, so I'm looking to purchase R2 and I'm still on the free plan meaning I can't really ask the support so I thought I'd ask here: I'm making an app where I just need a simple service for file uploads and I thought that R2 public buckets look really good for that, but I've got a few questions since they're almost undocumented on the documentation (maybe there's more when you purchase R2?). First of all, if my public bucket gets attacked by some sort of DDoS attack, will I be charged for every single file that the requests downloaded? And second, can you perform something like list operations on a public bucket or is it only download?

kian•10/30/23, 8:57 AM

First of all, if my public bucket gets attacked by some sort of DDoS attack, will I be charged for every single file that the requests downloaded?

Yes, but public buckets have cache and requests that hit cache never hit R2's billing.

kian•10/30/23, 8:57 AM

And second, can you perform something like list operations on a public bucket or is it only download?

Only download.

Unbreathable•10/30/23, 8:58 AM

kk, thanks for the quick help

Unbreathable•10/30/23, 9:12 AM

Another quick question: I've purchased R2 now and I created a bucket, but when I open the dashboard for the bucket, I get this error. Is this something normal or is something wrong with my bucket?

Maybe your home connection is slow and cannot handle opening too many videos at once.

Similar Threads

Similar Threads

Similar Threads