I created an issue on the community forum: https://community.cloudflare.com/t/suddenly-cannot-downlo

I created an issue on the community forum: https://community.cloudflare.com/t/suddenly-cannot-download-fetch-from-specific-r2-bucket-despite-no-config-changes/605553

Ffrankichiro Hello. Are there any official tutorials or documentation on how to work with R2 ...

dave•1/24/24, 12:11 AM

I use rclone,

aws s3

aws s3

and

aws s3api

aws s3api

(depending on what I am trying to do and what commands I remember off the top of my head)

Amit Bera•1/24/24, 5:51 AM

Suddenly not been able to access files via presigned URL generate via boto3 in python, its throwing me NoSuchKey error

AAmit Bera Suddenly not been able to access files via presigned URL generate via boto3 in p...

Unsmart•1/24/24, 5:52 AM

Sounds like either the access key used for signing doesnt exist or the object youre trying to access doesnt exist

mian.m.arslan•1/24/24, 9:53 AM

Hi every one
I am new to R2 storage
Can any one tell me hot can i download specific folder from R2.
Or make any folder shareable so other use see that and download that folder.

X•1/24/24, 11:14 AM

hi everyone

kian•1/24/24, 11:40 AM

The limit of 1,000? There isn't a way, you have to paginate

DDanS Interesting.... it seems that AWS S3 is able to do this.

kian•1/24/24, 4:29 PM

The list API is the same as S3

Ivan Adutskevich•1/24/24, 7:21 PM

Hi Guys! stupid question. I recently decided to give it a try with logpush. so i need to create an R2 bucket. i created it. but I cannot access it, I always receive "remote error: tls: handshake failure". I tried adding a logpush to r2 destination and also with postman R2 collection. What am I missing?

HHexstream I created an issue on the community forum: https://community.cloudflare.com/t/su...

HexstreamOP•1/25/24, 3:58 AM

"Great news!!"
Someone else has the same issue as me, so this is clearly not specific to my account...
(Frankly, I am slightly relieved... ¯\_(ツ)_/¯)
https://community.cloudflare.com/t/old-r2-file-not-accessible-anymore/604487

HexstreamOP•1/25/24, 4:01 AM

Anyway, gotta hit the hay. :)

Charlie•1/25/24, 9:20 AM

Hello everyone, anyone knows if there is going to be a Intelligent Tiering as in S3? If yes, someone knows any ETA? Mostly for something like Glacier Tiers

wizemike•1/25/24, 9:48 AM

hello!

wizemike•1/25/24, 9:58 AM

newbie question here - if I upload my files to R2, can I somehow point stream to it for processing - so we can avoid storing the same file twice in 2 parts of the network?

wizemike•1/25/24, 9:59 AM

or perhaps set stream up to use a dedicated bucket or folder from which to take video files to be processed?

Original message was deleted

wizemike•1/25/24, 10:03 AM

this in reply to. my question?

wizemike•1/25/24, 10:04 AM

yes - the intent is to upload first to r2 and then offer it for streaming a few minutes later

Original message was deleted

Chandan•1/25/24, 1:17 PM

@supernekonyannyan @erisachu @unsmart latest news on the uploading problems The customer service team stated that there is a limit on R2 and that it can't handle more than 300 uploads at this time. They said it was their long-term plan to handle higher volumes, but they didn't say when it would be fixed.

I was more hopeful about R2, but it won't work for us, so we need to stick to Google Storage or something else.

Original message was deleted

Chandan•1/25/24, 1:29 PM

probably, they didn't give much clarity, just stated that its backend limitation.

Erisa•1/25/24, 1:40 PM

Its not a hard written limit and more of a "if you go too high, R2 starts to break"

Erisa•1/25/24, 1:41 PM

Enjoy

Erisa•1/25/24, 1:41 PM

That would work

Erisa•1/25/24, 1:41 PM

Which support on which ticket? I am in Support myself

Erisa•1/25/24, 1:42 PM

Thats not a direct quote from a ticket, its what Chandan wrote

kian•1/25/24, 1:43 PM

Might be 3075872

kian•1/25/24, 1:43 PM

Bucket sharding has been the go-to for a long time in regards to the use-case of lots of concurrency for a single bucket.

dave•1/25/24, 2:16 PM

When using aws4fetch, is there any downside to signing the

cf-worker

cf-worker

header?

EErisa Its not a hard written limit and more of a "if you go too high, R2 starts to bre...

Charlie•1/25/24, 3:16 PM

Is there any way to overcome this, apart from bucket sharding?

CCharlie Is there any way to overcome this, apart from bucket sharding?

Erisa•1/25/24, 3:28 PM

No, as noted on the ticket, the product needs to be improved

Original message was deleted

Chandan•1/25/24, 3:54 PM

#3075872

Original message was deleted

Chandan•1/25/24, 3:55 PM

yes, simultaneous uploads

EErisa Which support on which ticket? I am in Support myself

Chandan•1/25/24, 3:57 PM

ticket id #3075872, same ticket which you were looking into it.

EErisa Thats not a direct quote from a ticket, its what Chandan wrote

Chandan•1/25/24, 4:01 PM

I wrote the above, but all I can understand from below reply, we already retrying but its just making it worse for reads too.

Engineering has confirmed that the trouble maybe related to the product capabilities itself.

There is a long term plan to improve the technical limitations and resiliency of the R2 product.
For now, they have suggested retries on failures.

Thank you.

Omar Shariff | Cloudflare Support

Engineering has confirmed that the trouble maybe related to the product capabilities itself.

There is a long term plan to improve the technical limitations and resiliency of the R2 product.
For now, they have suggested retries on failures.

Thank you.

Omar Shariff | Cloudflare Support

Erisa•1/25/24, 4:04 PM

It's due to limitations and resiliency of the product, but it isn't necessarily "300 concurrent = break", it's more nuanced than that. If you aren't able to work around the issue with retries or bucket sharding then I'm afraid that may mean that the product isn't currently well suited to your use-case

Kkian Bucket sharding has been the go-to for a long time in regards to the use-case of...

Chandan•1/25/24, 4:05 PM

we process almost 1-2 million of files a day, what type sharding can work for this?

Erisa•1/25/24, 4:05 PM

You would have to split them into different buckets

Erisa•1/25/24, 4:05 PM

As each bucket is "separate" as far as this issue is concerned

EErisa It's due to limitations and resiliency of the product, but it isn't necessarily ...

Chandan•1/25/24, 4:06 PM

yeah, I'm not saying hard limit, but its just my observation, where our application almost unusable.

Erisa•1/25/24, 4:06 PM

Understood

Erisa•1/25/24, 4:07 PM

Sorry about that, we checked all we could but it's just how it is at the moment

Charlie•1/25/24, 4:08 PM

Is this something that they are currently working on? Is there any public Roadmap people could see to track such things?

Engineering has confirmed that the trouble maybe related to the product capabilities itself. There is a long term plan to improve the technical limitations and resiliency of the R2 product. For now, they have suggested retries on failures. Thank you. Omar Shariff | Cloudflare Support

I created an issue on the community forum: https://community.cloudflare.com/t/suddenly-cannot-downlo

Similar Threads