Is R2 throttling uploads (via API) in any way? I'm experiencing what is looks like throttling. I wro

Is R2 throttling uploads (via API) in any way? I'm experiencing what is looks like throttling. I wrote a simple script that sends files to R2 in batches of 100, and after successfully sending 500 o 600, the network traffic stalls for a minute or so.

BabyShark•10/28/23, 6:16 PM

hi, how can I upload multi images in one time via API?

Aalexandernst Is R2 throttling uploads (via API) in any way? I'm experiencing what is looks li...

Unsmart•10/28/23, 6:36 PM

R2 does not have any throttling. I would probably wager that your ISP might be throttling your data in that case

UUnsmart R2 does not have any throttling. I would probably wager that your ISP might be t...

alexandernstOP•10/28/23, 6:37 PM

I thought that, but I get exactly the same result when trying to do the work from a hetzner machine in germany (I'm in spain)

mr nooli•10/28/23, 9:15 PM

I'm getting the following error when trying to set the cors policy for r2 -

There was a problem setting this bucket's CORS configuration, please try again later

There was a problem setting this bucket's CORS configuration, please try again later

am I being a

or is something down?

mr nooli•10/28/23, 9:41 PM

nvm ^ is working again

tt2468•10/28/23, 11:28 PM

I've got this weird issue with listing objects. The function in the screenshot used to return objects in our bucket, but simply doesn't now. An example object name that exists in our bucket is

1001_x2KasaV5awqZVhPekJvwHU_1696199791682_0.mp4

1001_x2KasaV5awqZVhPekJvwHU_1696199791682_0.mp4

, but providing the function with an account ID of

somehow offers 0 results.

kian•10/28/23, 11:42 PM

Is the file stored in the bucket root?

Colin•10/28/23, 11:50 PM

hey

has anyone been getting more

get: Please look at https://www.cloudflarestatus.com for issues or contact customer support. (10043)

get: Please look at https://www.cloudflarestatus.com for issues or contact customer support. (10043)

's than usual lately?

Colin•10/28/23, 11:50 PM

I just started noticing them today

Kkian Is the file stored in the bucket root?

tt2468•10/28/23, 11:54 PM

I think so?

kian•10/28/23, 11:57 PM

Are you running the code with wrangler dev?

tt2468•10/29/23, 12:07 AM

Normal wrangler afaik

tt2468•10/29/23, 12:07 AM

I do know the bucket itself is correct, since the

.get()

.get()

method for specific objects works as expected

tt2468•10/29/23, 12:37 AM

Looks like

delimiter

delimiter

may have been the cause

delta•10/29/23, 9:53 AM

Hello, i am unable to connect R2 bucket to custom domain, Status badge staying at initializing state. but conneting to another domain works well. also worker routing to custom domain is working well. any advise?

gluck•10/29/23, 12:53 PM

Hello, I am connecting to R2 from php, when creating a presigned url the generated url seems fine but browsing to it shows this error:
<Error>
<Code>NoSuchKey</Code>
<Message>The specified key does not exist.</Message>
</Error>

the key and secrets are fine as upload to bucket works fine

alexandernstOP•10/29/23, 6:37 PM

Is there a way to copy files from one bucket to another without downloading & uploading the files?

Erisa•10/29/23, 7:12 PM

If you had Tiered Cache enabled with DO then thats probably the discrepency. Currently R2 doesn't support tiered cache so the cache is per-colo and there are a lot of those.

Erisa•10/29/23, 7:12 PM

That's something that will hopefully be ironed out in future

Erisa•10/29/23, 7:18 PM

https://dash.cloudflare.com/?to=/:account/:zone/caching/tiered-cache is what I'm referring to, having it enabled would increase cache hit rate on DO but not on R2 due to current limitations.

If you have a Pro plan or higher you can view detailed cache analytics to find out where they're coming from. If not, what does your cache rule look like?

Original message was deleted

omar4289•10/29/23, 8:20 PM

Maybe your home connection is slow and cannot handle opening too many videos at once.

Oomar4289 Maybe your home connection is slow and cannot handle opening too many videos at ...

flayks•10/29/23, 8:20 PM

nah I have fiber and 1gbps down with very low latency

Fflayks nah I have fiber and 1gbps down with very low latency

omar4289•10/29/23, 8:21 PM

Check your network tab and see how long it takes to download the files (When reading videos from r2, you will have to download all of the content before you can read it)

omar4289•10/29/23, 8:22 PM

If that is inconvenient (Which it is most of the time), then you will need to have it as a stream

flayks•10/29/23, 8:23 PM

well each video starts playing but then buffers so I feel this is coming from R2

Fflayks well each video starts playing but then buffers so I feel this is coming from R2

omar4289•10/29/23, 8:24 PM

Oh ok, what do you see in devtools?

flayks•10/29/23, 8:25 PM

sometimes a Pending state for a solid 10-20sc

omar4289•10/29/23, 8:26 PM

Ok, never tried to play multiple videos from r2, lets wait for an answer from the official r2 team, but from documentation, I could not see such limitations

Original message was deleted

kev-ac•10/29/23, 8:40 PM

No thats not possible. Out of interest: What would be your use case to limit the download speed intentionally?

Original message was deleted

omar4289•10/29/23, 8:42 PM

I think you should be able to using a worker with r2

omar4289•10/29/23, 8:42 PM

There are streaming api which you can control as you want, but not sure if all can be done within the time allocated to workers

Oomar4289 There are streaming api which you can control as you want, but not sure if all c...

kev-ac•10/29/23, 8:44 PM

That would be definitely a problem as workers are more likely to be evicated after 30(?) seconds

kev-ac•10/29/23, 8:45 PM

If you need to implement something like this a server-side solution might be your only choice.

Original message was deleted

kev-ac•10/29/23, 8:47 PM

Yes. This way, hypothetically, you have full control over the flow. Even a simple nginx proxy with the correct configuration would do the trick here.

omar4289•10/29/23, 8:47 PM

You will need to implement a range download. Ranges will be smaller for freemium users.

omar4289•10/29/23, 8:48 PM

Kind of like send chunks of 7kb per second for freemium users and unlimited for premium

Oomar4289 Kind of like send chunks of 7kb per second for freemium users and unlimited for ...

kev-ac•10/29/23, 8:51 PM

I can't follow you how a range request would be slower than a full file download. Yes there is some protocol overhead if the chunks are very small, but with http2 negligible. And the next thing would be: How do you want to enforce this? I'm unsure if you can specify a content-range when creating a presigned URL.

Original message was deleted

kev-ac•10/29/23, 8:54 PM

I mean: Just try it. If the rule is correct you'll be greeted with an error. This should work but don't rely on it for content protection. What this will prevent is hotlinking to the URL.

kev-ac•10/29/23, 8:56 PM

You should implement URL signing for downloads, especially if you have paying customers. Otherwise a known direct download link would be valid forever (until the file is removed from R2)

kev-ac•10/29/23, 8:56 PM

@101budspencer If you want to go deeper here maybe consider opening a thread so it doesn't spam the channel too much.

Original message was deleted

kev-ac•10/29/23, 8:59 PM

Yes. You'll find more here: https://developers.cloudflare.com/r2/api/s3/presigned-urls/

Presigned URLs · Cloudflare R2 docs

Presigned URLs are an S3 concept for sharing direct access to your bucket without revealing your token secret. A presigned URL authorizes anyone with …

Original message was deleted

kev-ac•10/29/23, 9:01 PM

Just access. Once the download is ongoing it will complete.

Is R2 throttling uploads (via API) in any way? I'm experiencing what is looks like throttling. I wro

Similar Threads

Similar Threads

Similar Threads