Cloudflare Developers•3y ago

Is that near where you are?

IIsaac McFadyen The bucket should have been created nearby then. Do you see long access times fo...

ahmed•10/14/23, 6:13 PM

Yes, I don’t have many files as I have just started, but same result on at least 10 different files

Isaac McFadyenOP•10/14/23, 6:14 PM

Are you using a custom domain or the r2.dev domain?

IIsaac McFadyen Is that near where you are?

ahmed•10/14/23, 6:14 PM

I guess, I am in Pakistan and it is in Asia, so it should be

IIsaac McFadyen Are you using a custom domain or the r2.dev domain?

ahmed•10/14/23, 6:14 PM

Custom domain

ahmed•10/14/23, 6:15 PM

I think the response times are fast when cache is HIT

Aahmed I think the response times are fast when cache is HIT

Isaac McFadyenOP•10/14/23, 6:17 PM

Interesting. That's expected but still shouldn't be that slow on a MISS.

Isaac McFadyenOP•10/14/23, 6:17 PM

Can you try creating a new bucket, not specifying a location hint (leave the field blank so it auto-selects) and then check the response time on that?

Isaac McFadyenOP•10/14/23, 6:18 PM

It's possible that R2 just doesn't have much a presence in Pakistan and so response times are slow, but would be good to confirm that by checking another bucket that doesn't have a location hint selected.

ahmed•10/14/23, 6:20 PM

Ok let me try.

I faced similar issue with another CDN service, in case of cache MISS it went on to fetch file from origin which is in Germany. The issue started around 5 days back and their support told me that there is some cable cut issue between Hong Kong and Europe that is resulting in slow downloads. So, I started testing CF

ahmed•10/14/23, 6:22 PM

I think even if CF doesn't have server in Pakistan. It shouldn't take 15 seconds to fetch a file of few hundred kilobytes anywhere in the world.

ahmed•10/14/23, 6:22 PM

BTW CF has 3 servers in Pakistan. Also in the same city from where I am accessing. Not sure if those servers have R2.

Isaac McFadyenOP•10/14/23, 6:25 PM

Cloudflare doesn't publicize it's server info (only location info), so not sure where you're getting that info from - but yes, they do have servers in Pakistan. Just not sure they have R2.

IIsaac McFadyen Cloudflare doesn't publicize it's server info (only location info), so not sure ...

ahmed•10/14/23, 6:27 PM

https://www.cloudflare.com/network/

I check on this link

Aahmed https://www.cloudflare.com/network/ I check on this link

Isaac McFadyenOP•10/14/23, 6:28 PM

Oh, makes sense. Those are locations so they may have multiple servers in each one but regardless, R2 isn't directly related to Cloudflare locations.

Isaac McFadyenOP•10/14/23, 6:28 PM

Some locations will have R2 and some won't and Cloudflare doesn't make which ones public.

ahmed•10/14/23, 6:29 PM

Does R2 store data only in one location or does it replicate across servers?

Aahmed Does R2 store data only in one location or does it replicate across servers?

Isaac McFadyenOP•10/14/23, 6:30 PM

One location. Probably replicated across servers for redundancy but in one region, I believe.

Aahmed Ok let me try. I faced similar issue with another CDN service, in case of cache...

ahmed•10/14/23, 6:36 PM

Do you have any information on this? Could this be the reason?

Isaac McFadyenOP•10/14/23, 6:46 PM

Possibly? I don't know where R2 stores data for APAC, an R2 employee might have to investigate once the weekend is over.

Isaac McFadyenOP•10/14/23, 6:46 PM

If you're on a Pro plan or higher you could also try opening a ticket.

ahmed•10/14/23, 6:54 PM

Okay. Thank you so much for your assistance.

Erisa•10/14/23, 8:03 PM

not at the moment

omar4289•10/14/23, 8:53 PM

Hi everyone, I am trying to build a production ready application which serves the same image, uploaded to r2, to thousands of customers. We are a little bit skeptical on how r2 provides free egress, especially since in our case, the download rate will be thousands of times higher than the storage space occupied

Ddano Gotcha. I see that the console is hitting an undocumented api. Can I use that in...

Erisa•10/14/23, 9:29 PM

You can, there's just no guarantees about it working or staying the same since its undocumented

Oomar4289 Hi everyone, I am trying to build a production ready application which serves th...

Karew•10/15/23, 12:40 AM

Yes, it’s really free egress. Make sure that you add a custom domain to your bucket and configure Cache Rules for it to take full advantage of the cache too

Chris•10/15/23, 3:17 AM

I'm experiencing a bug when attaching a domain to an R2 bucket, which may be specific to specificly related to Punycode/IDN (Internationalized Domain Names).

The DNS records are successfully added and the TLS cert and https endpoint are initialized, but the website serves Error 1014. Additionally, an error message is shown when trying to "reconnect" the R2 custom domain using the "..." menu. Lastly, the DNS entries are not deleted (and the UI provides no options to delete if we delete the R2 custom domain, as shown by orphaned DNS entry

bin.føø.com (bin.xn--f-5gaa.com)

bin.føø.com (bin.xn--f-5gaa.com)

R2_domain_added142.95KB

f.com_HTTPS190.41KB

omar4289•10/15/23, 11:28 AM

hi guys, is there an easy way to serve r2 content through a cdn ?

Oomar4289 hi guys, is there an easy way to serve r2 content through a cdn ?

Hello, I’m Allie!•10/15/23, 11:31 AM

Just add a custom domain

HHello, I’m Allie!Just add a custom domain

omar4289•10/15/23, 11:32 AM

Thanks

Original message was deleted

digitalpoint•10/15/23, 5:43 PM

'#' is a special character for URLs (fragment identifier), so I suspect it has something to do with that. In a normal HTTP request, anything after the # is not sent as part of the underlying HTTP request. That being said, it does look like it's possibly a bug in R2. If I have a filename of

somefile#123.jpg

somefile#123.jpg

and I upload it via R2 dashboard, it shows as being uploaded as

somefile

somefile

, but accessing it via a URL encoded string (needed since anything after # isn't sent to the server by the browser). So the R2 upload process drops anything after the # (same as a browser would do making the request for it). At which point you would be left with an empty file.

A user could probably upload a carefullly crafted filename to overwrite other filenames. Although if you are allowing users to upload direct to R2 with filenames they choose, they could probably overwrite other files anyway.

If it's user generated content, you really don't want to be uploading them to R2 willy-nilly with the filename users uploaded it as anyway.

digitalpoint•10/15/23, 5:53 PM

Yep... I uploaded a file via the dashboard as a test...

somefile#123.jpg

somefile#123.jpg

ended up as

somefile

somefile

in the dashboard. I was too scared to try it with a file that started with

because I didn't want to end up an object that wasn't deletable.

digitalpoint•10/15/23, 5:56 PM

Seems so... it's how browsers handle requests with

in it, so it's not the only place in the world that works that way, but uploading to R2 isn't a normal browser request. Might be something like they are parsing the uploaded R2 object key as a URL path, and if it's a URL path, anything after

would be dropped. It does seem like a bug to me.

digitalpoint•10/15/23, 5:57 PM

Or maybe you just need to URL encode object keys when uploading?

digitalpoint•10/15/23, 5:58 PM

But even if you are supposed to that, the normal R2 dashboard isn't doing it, so...

digitalpoint•10/15/23, 6:05 PM

You might want to try URL encoding it... Looking at the underlying mechanism for uploading an object, the object key is part of the S3 endpoint... so underneath it all, you are sending the request to:

PUT https://{account_id}.r2.cloudflarestorage.com/{bucketname}/{object_key}

PUT https://{account_id}.r2.cloudflarestorage.com/{bucketname}/{object_key}

So I bet that's the culprit right there... the "filename" being part of the request. And anything after the

isn't valid in an HTTP request.

It might be as simple as URL encoding the filename.

digitalpoint•10/15/23, 6:07 PM

...if that's the case maybe it's just a bug in Cloudflare's dashboard and they need to be URL encoding it themselves too (and they are not).

SShah Has anyone been able to make requests using rust to create bucket etc? I'm havin...

digitalpoint•10/15/23, 6:15 PM

It's not an "official" endpoint, but you can create buckets with Cloudflare API without using S3 API.

public function createR2Bucket($accountId, $bucketName)
{
    $params = [
        'name' => $bucketName,
    ];
    return $this->makeRequest('POST', sprintf('accounts/%s/r2/buckets', $accountId), ['json' => $params]);
}

public function createR2Bucket($accountId, $bucketName)
{
    $params = [
        'name' => $bucketName,
    ];
    return $this->makeRequest('POST', sprintf('accounts/%s/r2/buckets', $accountId), ['json' => $params]);
}

That can change at any time though, and doesn't solve your problem of improperly signed S3 requests. So uploading objects and other operations are going to also fail.

digitalpoint•10/15/23, 6:18 PM

If you mean an endpoint different than

https://{account_id}.r2.cloudflarestorage.com/{bucketname}/

https://{account_id}.r2.cloudflarestorage.com/{bucketname}/

, no. The S3 API does not work on custom public domains for buckets (so for example you can't have a presigned URL within your own domain)

digitalpoint•10/15/23, 6:20 PM

If it works with S3, it should work with R2 (mostly)

public function createR2Bucket($accountId, $bucketName) { $params = [ 'name' => $bucketName, ]; return $this->makeRequest('POST', sprintf('accounts/%s/r2/buckets', $accountId), ['json' => $params]); }

Is that near where you are?

Similar Threads

Similar Threads

Similar Threads