Very slow file download performance on R2, Cache connected but it was a cache MISS. Accessing from K

Very slow file download performance on R2, Cache connected but it was a cache MISS. Accessing from Karachi, PK. What could be the reason?

Aahmed Very slow file download performance on R2, Cache connected but it was a cache MI...

ahmedOP•10/14/23, 4:49 PM

Aahmed Click to see attachment

Isaac McFadyen•10/14/23, 6:10 PM

Cloudflare IPs are anycast so that IP address isn't actually in California, it's advertised all over the world and then people connect to the closest one. The IP won't be the issue.

Isaac McFadyen•10/14/23, 6:10 PM

R2 buckets are created closest to the person who created them - did you create your R2 bucket when connected to the same network you are right now?

IIsaac McFadyen R2 buckets are created closest to the person who created them - did you create y...

ahmedOP•10/14/23, 6:12 PM

Not the same network. But I created from my workplace which is in same city

Isaac McFadyen•10/14/23, 6:12 PM

The bucket should have been created nearby then. Do you see long access times for any other objects? Is it consistently slow?

ahmedOP•10/14/23, 6:12 PM

I think I selected APAC in the location hint

Aahmed I think I selected APAC in the location hint

Isaac McFadyen•10/14/23, 6:12 PM

Is that near where you are?

IIsaac McFadyen The bucket should have been created nearby then. Do you see long access times fo...

ahmedOP•10/14/23, 6:13 PM

Yes, I don’t have many files as I have just started, but same result on at least 10 different files

Isaac McFadyen•10/14/23, 6:14 PM

Are you using a custom domain or the r2.dev domain?

IIsaac McFadyen Is that near where you are?

ahmedOP•10/14/23, 6:14 PM

I guess, I am in Pakistan and it is in Asia, so it should be

IIsaac McFadyen Are you using a custom domain or the r2.dev domain?

ahmedOP•10/14/23, 6:14 PM

Custom domain

ahmedOP•10/14/23, 6:15 PM

I think the response times are fast when cache is HIT

Aahmed I think the response times are fast when cache is HIT

Isaac McFadyen•10/14/23, 6:17 PM

Interesting. That's expected but still shouldn't be that slow on a MISS.

Isaac McFadyen•10/14/23, 6:17 PM

Can you try creating a new bucket, not specifying a location hint (leave the field blank so it auto-selects) and then check the response time on that?

Isaac McFadyen•10/14/23, 6:18 PM

It's possible that R2 just doesn't have much a presence in Pakistan and so response times are slow, but would be good to confirm that by checking another bucket that doesn't have a location hint selected.

ahmedOP•10/14/23, 6:20 PM

Ok let me try.

I faced similar issue with another CDN service, in case of cache MISS it went on to fetch file from origin which is in Germany. The issue started around 5 days back and their support told me that there is some cable cut issue between Hong Kong and Europe that is resulting in slow downloads. So, I started testing CF

ahmedOP•10/14/23, 6:22 PM

I think even if CF doesn't have server in Pakistan. It shouldn't take 15 seconds to fetch a file of few hundred kilobytes anywhere in the world.

ahmedOP•10/14/23, 6:22 PM

BTW CF has 3 servers in Pakistan. Also in the same city from where I am accessing. Not sure if those servers have R2.

Isaac McFadyen•10/14/23, 6:25 PM

Cloudflare doesn't publicize it's server info (only location info), so not sure where you're getting that info from - but yes, they do have servers in Pakistan. Just not sure they have R2.

IIsaac McFadyen Cloudflare doesn't publicize it's server info (only location info), so not sure ...

ahmedOP•10/14/23, 6:27 PM

https://www.cloudflare.com/network/

I check on this link

Aahmed https://www.cloudflare.com/network/ I check on this link

Isaac McFadyen•10/14/23, 6:28 PM

Oh, makes sense. Those are locations so they may have multiple servers in each one but regardless, R2 isn't directly related to Cloudflare locations.

Isaac McFadyen•10/14/23, 6:28 PM

Some locations will have R2 and some won't and Cloudflare doesn't make which ones public.

ahmedOP•10/14/23, 6:29 PM

Does R2 store data only in one location or does it replicate across servers?

Aahmed Does R2 store data only in one location or does it replicate across servers?

Isaac McFadyen•10/14/23, 6:30 PM

One location. Probably replicated across servers for redundancy but in one region, I believe.

Aahmed Ok let me try. I faced similar issue with another CDN service, in case of cache...

ahmedOP•10/14/23, 6:36 PM

Do you have any information on this? Could this be the reason?

Isaac McFadyen•10/14/23, 6:46 PM

Possibly? I don't know where R2 stores data for APAC, an R2 employee might have to investigate once the weekend is over.

Isaac McFadyen•10/14/23, 6:46 PM

If you're on a Pro plan or higher you could also try opening a ticket.

ahmedOP•10/14/23, 6:54 PM

Okay. Thank you so much for your assistance.

Erisa•10/14/23, 8:03 PM

not at the moment

omar4289•10/14/23, 8:53 PM

Hi everyone, I am trying to build a production ready application which serves the same image, uploaded to r2, to thousands of customers. We are a little bit skeptical on how r2 provides free egress, especially since in our case, the download rate will be thousands of times higher than the storage space occupied

Ddano Gotcha. I see that the console is hitting an undocumented api. Can I use that in...

Erisa•10/14/23, 9:29 PM

You can, there's just no guarantees about it working or staying the same since its undocumented

Oomar4289 Hi everyone, I am trying to build a production ready application which serves th...

Karew•10/15/23, 12:40 AM

Yes, it’s really free egress. Make sure that you add a custom domain to your bucket and configure Cache Rules for it to take full advantage of the cache too

Chris•10/15/23, 3:17 AM

I'm experiencing a bug when attaching a domain to an R2 bucket, which may be specific to specificly related to Punycode/IDN (Internationalized Domain Names).

The DNS records are successfully added and the TLS cert and https endpoint are initialized, but the website serves Error 1014. Additionally, an error message is shown when trying to "reconnect" the R2 custom domain using the "..." menu. Lastly, the DNS entries are not deleted (and the UI provides no options to delete if we delete the R2 custom domain, as shown by orphaned DNS entry

bin.føø.com (bin.xn--f-5gaa.com)

bin.føø.com (bin.xn--f-5gaa.com)

R2_domain_added142.95KB

f.com_HTTPS190.41KB

omar4289•10/15/23, 11:28 AM

hi guys, is there an easy way to serve r2 content through a cdn ?

Oomar4289 hi guys, is there an easy way to serve r2 content through a cdn ?

Hello, I’m Allie!•10/15/23, 11:31 AM

Just add a custom domain

HHello, I’m Allie!Just add a custom domain

omar4289•10/15/23, 11:32 AM

Thanks

Original message was deleted

digitalpoint•10/15/23, 5:43 PM

'#' is a special character for URLs (fragment identifier), so I suspect it has something to do with that. In a normal HTTP request, anything after the # is not sent as part of the underlying HTTP request. That being said, it does look like it's possibly a bug in R2. If I have a filename of

somefile#123.jpg

somefile#123.jpg

and I upload it via R2 dashboard, it shows as being uploaded as

somefile

somefile

, but accessing it via a URL encoded string (needed since anything after # isn't sent to the server by the browser). So the R2 upload process drops anything after the # (same as a browser would do making the request for it). At which point you would be left with an empty file.

A user could probably upload a carefullly crafted filename to overwrite other filenames. Although if you are allowing users to upload direct to R2 with filenames they choose, they could probably overwrite other files anyway.

If it's user generated content, you really don't want to be uploading them to R2 willy-nilly with the filename users uploaded it as anyway.

digitalpoint•10/15/23, 5:53 PM

Yep... I uploaded a file via the dashboard as a test...

somefile#123.jpg

somefile#123.jpg

ended up as

somefile

somefile

in the dashboard. I was too scared to try it with a file that started with

because I didn't want to end up an object that wasn't deletable.

digitalpoint•10/15/23, 5:56 PM

Seems so... it's how browsers handle requests with

in it, so it's not the only place in the world that works that way, but uploading to R2 isn't a normal browser request. Might be something like they are parsing the uploaded R2 object key as a URL path, and if it's a URL path, anything after

would be dropped. It does seem like a bug to me.

digitalpoint•10/15/23, 5:57 PM

Or maybe you just need to URL encode object keys when uploading?

digitalpoint•10/15/23, 5:58 PM

But even if you are supposed to that, the normal R2 dashboard isn't doing it, so...

digitalpoint•10/15/23, 6:05 PM

You might want to try URL encoding it... Looking at the underlying mechanism for uploading an object, the object key is part of the S3 endpoint... so underneath it all, you are sending the request to:

PUT https://{account_id}.r2.cloudflarestorage.com/{bucketname}/{object_key}

PUT https://{account_id}.r2.cloudflarestorage.com/{bucketname}/{object_key}

So I bet that's the culprit right there... the "filename" being part of the request. And anything after the

isn't valid in an HTTP request.

It might be as simple as URL encoding the filename.

digitalpoint•10/15/23, 6:07 PM

...if that's the case maybe it's just a bug in Cloudflare's dashboard and they need to be URL encoding it themselves too (and they are not).

SShah Has anyone been able to make requests using rust to create bucket etc? I'm havin...

digitalpoint•10/15/23, 6:15 PM

It's not an "official" endpoint, but you can create buckets with Cloudflare API without using S3 API.

public function createR2Bucket($accountId, $bucketName)
{
    $params = [
        'name' => $bucketName,
    ];
    return $this->makeRequest('POST', sprintf('accounts/%s/r2/buckets', $accountId), ['json' => $params]);
}

public function createR2Bucket($accountId, $bucketName)
{
    $params = [
        'name' => $bucketName,
    ];
    return $this->makeRequest('POST', sprintf('accounts/%s/r2/buckets', $accountId), ['json' => $params]);
}

That can change at any time though, and doesn't solve your problem of improperly signed S3 requests. So uploading objects and other operations are going to also fail.

public function createR2Bucket($accountId, $bucketName) { $params = [ 'name' => $bucketName, ]; return $this->makeRequest('POST', sprintf('accounts/%s/r2/buckets', $accountId), ['json' => $params]); }

Very slow file download performance on R2, Cache connected but it was a cache MISS. Accessing from K

Similar Threads

Similar Threads

Similar Threads