Ok let me try. I faced similar issue with another CDN service, in case of cache MISS it went on to

Ok let me try.

I faced similar issue with another CDN service, in case of cache MISS it went on to fetch file from origin which is in Germany. The issue started around 5 days back and their support told me that there is some cable cut issue between Hong Kong and Europe that is resulting in slow downloads. So, I started testing CF

ahmedOP•10/14/23, 6:22 PM

I think even if CF doesn't have server in Pakistan. It shouldn't take 15 seconds to fetch a file of few hundred kilobytes anywhere in the world.

ahmedOP•10/14/23, 6:22 PM

BTW CF has 3 servers in Pakistan. Also in the same city from where I am accessing. Not sure if those servers have R2.

Isaac McFadyen•10/14/23, 6:25 PM

Cloudflare doesn't publicize it's server info (only location info), so not sure where you're getting that info from - but yes, they do have servers in Pakistan. Just not sure they have R2.

IIsaac McFadyen Cloudflare doesn't publicize it's server info (only location info), so not sure ...

ahmedOP•10/14/23, 6:27 PM

https://www.cloudflare.com/network/

I check on this link

Aahmed https://www.cloudflare.com/network/ I check on this link

Isaac McFadyen•10/14/23, 6:28 PM

Oh, makes sense. Those are locations so they may have multiple servers in each one but regardless, R2 isn't directly related to Cloudflare locations.

Isaac McFadyen•10/14/23, 6:28 PM

Some locations will have R2 and some won't and Cloudflare doesn't make which ones public.

ahmedOP•10/14/23, 6:29 PM

Does R2 store data only in one location or does it replicate across servers?

Aahmed Does R2 store data only in one location or does it replicate across servers?

Isaac McFadyen•10/14/23, 6:30 PM

One location. Probably replicated across servers for redundancy but in one region, I believe.

Aahmed Ok let me try. I faced similar issue with another CDN service, in case of cache...

ahmedOP•10/14/23, 6:36 PM

Do you have any information on this? Could this be the reason?

Isaac McFadyen•10/14/23, 6:46 PM

Possibly? I don't know where R2 stores data for APAC, an R2 employee might have to investigate once the weekend is over.

Isaac McFadyen•10/14/23, 6:46 PM

If you're on a Pro plan or higher you could also try opening a ticket.

ahmedOP•10/14/23, 6:54 PM

Okay. Thank you so much for your assistance.

Erisa•10/14/23, 8:03 PM

not at the moment

omar4289•10/14/23, 8:53 PM

Hi everyone, I am trying to build a production ready application which serves the same image, uploaded to r2, to thousands of customers. We are a little bit skeptical on how r2 provides free egress, especially since in our case, the download rate will be thousands of times higher than the storage space occupied

Ddano Gotcha. I see that the console is hitting an undocumented api. Can I use that in...

Erisa•10/14/23, 9:29 PM

You can, there's just no guarantees about it working or staying the same since its undocumented

Oomar4289 Hi everyone, I am trying to build a production ready application which serves th...

Karew•10/15/23, 12:40 AM

Yes, it’s really free egress. Make sure that you add a custom domain to your bucket and configure Cache Rules for it to take full advantage of the cache too

Chris•10/15/23, 3:17 AM

I'm experiencing a bug when attaching a domain to an R2 bucket, which may be specific to specificly related to Punycode/IDN (Internationalized Domain Names).

The DNS records are successfully added and the TLS cert and https endpoint are initialized, but the website serves Error 1014. Additionally, an error message is shown when trying to "reconnect" the R2 custom domain using the "..." menu. Lastly, the DNS entries are not deleted (and the UI provides no options to delete if we delete the R2 custom domain, as shown by orphaned DNS entry

bin.føø.com (bin.xn--f-5gaa.com)

bin.føø.com (bin.xn--f-5gaa.com)

R2_domain_added142.95KB

f.com_HTTPS190.41KB

omar4289•10/15/23, 11:28 AM

hi guys, is there an easy way to serve r2 content through a cdn ?

Oomar4289 hi guys, is there an easy way to serve r2 content through a cdn ?

Hello, I’m Allie!•10/15/23, 11:31 AM

Just add a custom domain

HHello, I’m Allie!Just add a custom domain

omar4289•10/15/23, 11:32 AM

Thanks

Original message was deleted

digitalpoint•10/15/23, 5:43 PM

'#' is a special character for URLs (fragment identifier), so I suspect it has something to do with that. In a normal HTTP request, anything after the # is not sent as part of the underlying HTTP request. That being said, it does look like it's possibly a bug in R2. If I have a filename of

somefile#123.jpg

somefile#123.jpg

and I upload it via R2 dashboard, it shows as being uploaded as

somefile

somefile

, but accessing it via a URL encoded string (needed since anything after # isn't sent to the server by the browser). So the R2 upload process drops anything after the # (same as a browser would do making the request for it). At which point you would be left with an empty file.

A user could probably upload a carefullly crafted filename to overwrite other filenames. Although if you are allowing users to upload direct to R2 with filenames they choose, they could probably overwrite other files anyway.

If it's user generated content, you really don't want to be uploading them to R2 willy-nilly with the filename users uploaded it as anyway.

digitalpoint•10/15/23, 5:53 PM

Yep... I uploaded a file via the dashboard as a test...

somefile#123.jpg

somefile#123.jpg

ended up as

somefile

somefile

in the dashboard. I was too scared to try it with a file that started with

because I didn't want to end up an object that wasn't deletable.

digitalpoint•10/15/23, 5:56 PM

Seems so... it's how browsers handle requests with

in it, so it's not the only place in the world that works that way, but uploading to R2 isn't a normal browser request. Might be something like they are parsing the uploaded R2 object key as a URL path, and if it's a URL path, anything after

would be dropped. It does seem like a bug to me.

digitalpoint•10/15/23, 5:57 PM

Or maybe you just need to URL encode object keys when uploading?

digitalpoint•10/15/23, 5:58 PM

But even if you are supposed to that, the normal R2 dashboard isn't doing it, so...

digitalpoint•10/15/23, 6:05 PM

You might want to try URL encoding it... Looking at the underlying mechanism for uploading an object, the object key is part of the S3 endpoint... so underneath it all, you are sending the request to:

PUT https://{account_id}.r2.cloudflarestorage.com/{bucketname}/{object_key}

PUT https://{account_id}.r2.cloudflarestorage.com/{bucketname}/{object_key}

So I bet that's the culprit right there... the "filename" being part of the request. And anything after the

isn't valid in an HTTP request.

It might be as simple as URL encoding the filename.

digitalpoint•10/15/23, 6:07 PM

...if that's the case maybe it's just a bug in Cloudflare's dashboard and they need to be URL encoding it themselves too (and they are not).

SShah Has anyone been able to make requests using rust to create bucket etc? I'm havin...

digitalpoint•10/15/23, 6:15 PM

It's not an "official" endpoint, but you can create buckets with Cloudflare API without using S3 API.

public function createR2Bucket($accountId, $bucketName)
{
    $params = [
        'name' => $bucketName,
    ];
    return $this->makeRequest('POST', sprintf('accounts/%s/r2/buckets', $accountId), ['json' => $params]);
}

public function createR2Bucket($accountId, $bucketName)
{
    $params = [
        'name' => $bucketName,
    ];
    return $this->makeRequest('POST', sprintf('accounts/%s/r2/buckets', $accountId), ['json' => $params]);
}

That can change at any time though, and doesn't solve your problem of improperly signed S3 requests. So uploading objects and other operations are going to also fail.

digitalpoint•10/15/23, 6:18 PM

If you mean an endpoint different than

https://{account_id}.r2.cloudflarestorage.com/{bucketname}/

https://{account_id}.r2.cloudflarestorage.com/{bucketname}/

, no. The S3 API does not work on custom public domains for buckets (so for example you can't have a presigned URL within your own domain)

digitalpoint•10/15/23, 6:20 PM

If it works with S3, it should work with R2 (mostly)

digitalpoint•10/15/23, 6:24 PM

Maybe I'm missing something, but postman looks like it's just an abstraction layer on top of the S3 API. If I were you, I'd skip postman and just use the S3 API since that's what it's probably using underneath it all anyway.

Matt•10/16/23, 2:14 AM

Is there any way to associate metadata with a file in R2? It looks like S3 "object tags aren't supported"

Matt•10/16/23, 2:15 AM

Use case is being able to associate a set of files with a "project" and perform bulk actions on them later

omar4289•10/16/23, 6:46 AM

If I write data from my worker to r2, will I get billed for the worker execution time while the file is being uploaded ?

bigansh•10/16/23, 7:21 AM

i am uploading images and stuff to my storage. but is there a system that i can follow to delete the stored object if its related party is deleted on the mongodb? like i am uploading an image to r2 & then using the url for the image in the document as a header whoes object is stored in mongo. if that document is deleted in mongo, how do i delete the image in r2? like any guidance?

omar4289•10/16/23, 8:10 AM

Mongodb offers change events that you can use to know when entities are deleted, then react upon deletion

omar4289•10/16/23, 8:10 AM

I would also suggest that you have cron jobs, every once in a while to delete unreferenced files

omar4289•10/16/23, 8:13 AM

You could also use some queues that you trigger from your application when entities that references a file has been deleted/updated

public function createR2Bucket($accountId, $bucketName) { $params = [ 'name' => $bucketName, ]; return $this->makeRequest('POST', sprintf('accounts/%s/r2/buckets', $accountId), ['json' => $params]); }

Ok let me try. I faced similar issue with another CDN service, in case of cache MISS it went on to

Similar Threads

Similar Threads

Similar Threads