What is the difference between R2 and Cache Reserve. My use case is video delivery, around 100 to 1

What is the difference between R2 and Cache Reserve.

My use case is video delivery, around 100 to 120 TB per month. Currently, I have my video files on Wasabi. As per my understanding, Cache Reserve will fetch files automatically from my origin and store it permanently (on R2 itself), and in case I go with R2, I will have to upload files myself and it would same as storing files as on Wasabi. I want to understand the difference in the delivery of R2 and Cache Reserve, is it same CDN distributed globally or R2 is just a storage with free egress and requires a CDN separately for delivering 100+ TB of video content?

Aahmed What is the difference between R2 and Cache Reserve. My use case is video deliv...

Hello, I’m Allie!•10/12/23, 3:14 PM

You would basically be paying twice the storage costs if you used Wasabi+Cache Reserve. Plus, lower-accessed objects may be evicted from Cache Reserve after 30 days. I would go with R2

HHello, I’m Allie!You would basically be paying twice the storage costs if you used Wasabi+Cache R...

ahmedOP•10/12/23, 3:15 PM

So R2 also uses Cloudflare CDN? Is it good for video delivery?

Aahmed So R2 also uses Cloudflare CDN? Is it good for video delivery?

Hello, I’m Allie!•10/12/23, 3:15 PM

Yes

starina_cool•10/12/23, 4:30 PM

This happens when I turn Cache reserve on. It looks that it takes a lot of time to save file to R2 bucket.

Admir•10/12/23, 5:05 PM

I am uploading images from my react website to R2, everything is sucesfull but now i want to retrive the url of the uploaded image, any advice is welcome

import express from 'express';
import multer from 'multer';
import cors from 'cors';
import { S3Client, PutObjectCommand } from '@aws-sdk/client-s3';
import dotenv from 'dotenv';

const app = express();
const port = 4000;
app.use(cors());
dotenv.config();

const storage = multer.memoryStorage();
const upload = multer({
  storage,
});

app.post('/upload', upload.single('file'), async (req, res) => {
  const S3 = new S3Client({
    region: 'auto',
    endpoint: process.env.ENDPOINT,
    credentials: {
      accessKeyId: process.env.R2_ACCESS_KEY_ID,
      secretAccessKey: process.env.R2_SECRET_ACCESS_KEY,
    },
  });

  await S3.send(
    new PutObjectCommand({
      Body: req.file.buffer,
      Bucket: 'travelme',
      Key: req.file.originalname,
      ContentType: req.file.mimetype,
    })
  );
  res.send('File Uploaded' + ' ' + req.file.originalname);
});

import express from 'express';
import multer from 'multer';
import cors from 'cors';
import { S3Client, PutObjectCommand } from '@aws-sdk/client-s3';
import dotenv from 'dotenv';

const app = express();
const port = 4000;
app.use(cors());
dotenv.config();

const storage = multer.memoryStorage();
const upload = multer({
  storage,
});

app.post('/upload', upload.single('file'), async (req, res) => {
  const S3 = new S3Client({
    region: 'auto',
    endpoint: process.env.ENDPOINT,
    credentials: {
      accessKeyId: process.env.R2_ACCESS_KEY_ID,
      secretAccessKey: process.env.R2_SECRET_ACCESS_KEY,
    },
  });

  await S3.send(
    new PutObjectCommand({
      Body: req.file.buffer,
      Bucket: 'travelme',
      Key: req.file.originalname,
      ContentType: req.file.mimetype,
    })
  );
  res.send('File Uploaded' + ' ' + req.file.originalname);
});

and in my react

  const [file, setFile] = useState('');

  const handleChange = (e) => {
    setFile(e.target.files[0]);
  };

  const handleSubmit = async (e) => {
    e.preventDefault();
    const formData = new FormData();
    formData.append('file', file);
    const response = await fetch('http://localhost:4000/upload', {
      method: 'POST',
      body: formData,
    });

    const message = await response.text();
    console.log(message);
  };

  const [file, setFile] = useState('');

  const handleChange = (e) => {
    setFile(e.target.files[0]);
  };

  const handleSubmit = async (e) => {
    e.preventDefault();
    const formData = new FormData();
    formData.append('file', file);
    const response = await fetch('http://localhost:4000/upload', {
      method: 'POST',
      body: formData,
    });

    const message = await response.text();
    console.log(message);
  };

AAdmir I am uploading images from my react website to R2, everything is sucesfull but n...

digitalpoint•10/12/23, 5:09 PM

The URL is going to be based on the key (which is what looks like a path/filename normally) you upload the file as. If it's a public bucket (with a public domain as

images.yourdomain.com

images.yourdomain.com

), and you upload an image with a key of

something/image.png

something/image.png

, the URL would be https://images.yourdomain.com/something/image.png

Ddigitalpoint The URL is going to be based on the key (which is what looks like a path/filenam...

Admir•10/12/23, 5:14 PM

thank you, it works

Austin B•10/12/23, 6:16 PM

~~I'm looking to try out SIppy on a bucket; what permissions are required on the CloudFlare API token to enable this? I can't find that in the documentation anywhere. Thanks!~~

Found it. It is the

Account.Workers R2 Storage

Account.Workers R2 Storage

permission that is required to set it up.

HHello, I’m Allie!Yes

ahmedOP•10/12/23, 6:21 PM

Are cached requests counted as Class B operations?

Aahmed Are cached requests counted as Class B operations?

Hello, I’m Allie!•10/12/23, 6:22 PM

Nope

Hello, I’m Allie!•10/12/23, 6:22 PM

As long as a request is cacheable(below the size limit, etc.)

Sshaep778 so just to be sure... we won't pay for any LIST requests on s3, just GET request...

Karew•10/12/23, 6:36 PM

Right, it shouldn't be listing your S3 bucket, it should only be checking for individual items

Mmojmir3090 Hey there. I have a CF worker who's fetching data from R2 through bindings. Is t...

Karew•10/12/23, 9:27 PM

If you take advantage of the cache you can conserve transactions from R2

Old Man Maker•10/13/23, 5:26 AM

hi - I'm getting a CORS error on an R2 bucket that is making no sense to me (I'm sure it's my understanding that is wrong though)

I have edited my CORS settings as shown in the image and can access items from the bucket from other apps.

I am getting this error:
Access to fetch at '<BUCKET-ASSET>' from origin 'http://localhost:8080' has been blocked by CORS policy: The 'Access-Control-Allow-Origin' header has a value 'http://localhost:8081' that is not equal to the supplied origin. Have the server send the header with a valid value, or, if an opaque response serves your needs, set the request's mode to 'no-cors' to fetch the resource with CORS disabled.

What does that error even mean? Is Chrome sending the wrong URL in the header, or is CF sending back a different URL?

Any thoughts would be really appreciated

RRicardas Hi, anyone experiencing issues with Reading and Writing to R2 using @aws-sdk/cli...

Karew•10/13/23, 7:56 AM

Did your R2 token expire?

Palash Bansal•10/13/23, 8:54 AM

Hello, is there anything similar to Worker Routes but for r2? i.e mapping a route within a domain instead of the entire domain or subdomain to a R2 bucket without having a worker in the middle.

maurus•10/13/23, 9:29 AM

I just created a new R2 bucket within the EU jurisdiction, but the dashboard is showing internal errors (code 10001) for the policy endpoint. If I create a bucket with an automatic location, this does not happen. Is this a known issue?

kian•10/13/23, 12:48 PM

Yes

OOld Man Maker hi - I'm getting a CORS error on an R2 bucket that is making no sense to me (I'm...

Old Man Maker•10/13/23, 1:01 PM

Still no solution for this?

HHello, I’m Allie!As long as a request is cacheable(below the size limit, etc.)

ahmedOP•10/14/23, 3:02 PM

What is the size limit? Also, is there any difference in caching on different plans?

Aahmed What is the size limit? Also, is there any difference in caching on different pl...

Hello, I’m Allie!•10/14/23, 3:25 PM

Free, Pro and Business customers have a limit of 512 MB.
For Enterprise customers the default maximum cacheable file size is 5 GB. Contact your account team to request a limit increase.

- Default Cache Behavior

Default Cache Behavior · Cloudflare Cache (CDN) docs

Cloudflare respects the origin web server’s cache headers in the following order unless an Edge Cache TTL page rule overrides the headers.

HHello, I’m Allie!> Free, Pro and Business customers have a limit of 512 MB. > For Enterprise cust...

ahmedOP•10/14/23, 3:41 PM

Thanks. I am looking for the difference in network quality or other similar factors that may affect experience of the user in terms of performance for different plans. I didn’t find anything on that in the docs.
My use case is video delivery (HLS), video segments would be stored in Cloudflare R2. The video files are broken into many chunks of 10 seconds, so it would be many small files. I want to know if it would make any difference in performance based on plans?

ahmedOP•10/14/23, 4:47 PM

Very slow file download performance on R2, Cache connected but it was a cache MISS. Accessing from Karachi, PK. What could be the reason?

Aahmed Very slow file download performance on R2, Cache connected but it was a cache MI...

ahmedOP•10/14/23, 4:49 PM

Aahmed Click to see attachment

Isaac McFadyen•10/14/23, 6:10 PM

Cloudflare IPs are anycast so that IP address isn't actually in California, it's advertised all over the world and then people connect to the closest one. The IP won't be the issue.

Isaac McFadyen•10/14/23, 6:10 PM

R2 buckets are created closest to the person who created them - did you create your R2 bucket when connected to the same network you are right now?

IIsaac McFadyen R2 buckets are created closest to the person who created them - did you create y...

ahmedOP•10/14/23, 6:12 PM

Not the same network. But I created from my workplace which is in same city

Isaac McFadyen•10/14/23, 6:12 PM

The bucket should have been created nearby then. Do you see long access times for any other objects? Is it consistently slow?

ahmedOP•10/14/23, 6:12 PM

I think I selected APAC in the location hint

Aahmed I think I selected APAC in the location hint

Isaac McFadyen•10/14/23, 6:12 PM

Is that near where you are?

IIsaac McFadyen The bucket should have been created nearby then. Do you see long access times fo...

ahmedOP•10/14/23, 6:13 PM

Yes, I don’t have many files as I have just started, but same result on at least 10 different files

Isaac McFadyen•10/14/23, 6:14 PM

Are you using a custom domain or the r2.dev domain?

IIsaac McFadyen Is that near where you are?

ahmedOP•10/14/23, 6:14 PM

I guess, I am in Pakistan and it is in Asia, so it should be

IIsaac McFadyen Are you using a custom domain or the r2.dev domain?

ahmedOP•10/14/23, 6:14 PM

Custom domain

ahmedOP•10/14/23, 6:15 PM

I think the response times are fast when cache is HIT

Aahmed I think the response times are fast when cache is HIT

Isaac McFadyen•10/14/23, 6:17 PM

Interesting. That's expected but still shouldn't be that slow on a MISS.

Isaac McFadyen•10/14/23, 6:17 PM

Can you try creating a new bucket, not specifying a location hint (leave the field blank so it auto-selects) and then check the response time on that?

Isaac McFadyen•10/14/23, 6:18 PM

It's possible that R2 just doesn't have much a presence in Pakistan and so response times are slow, but would be good to confirm that by checking another bucket that doesn't have a location hint selected.

ahmedOP•10/14/23, 6:20 PM

Ok let me try.

I faced similar issue with another CDN service, in case of cache MISS it went on to fetch file from origin which is in Germany. The issue started around 5 days back and their support told me that there is some cable cut issue between Hong Kong and Europe that is resulting in slow downloads. So, I started testing CF

ahmedOP•10/14/23, 6:22 PM

I think even if CF doesn't have server in Pakistan. It shouldn't take 15 seconds to fetch a file of few hundred kilobytes anywhere in the world.

ahmedOP•10/14/23, 6:22 PM

BTW CF has 3 servers in Pakistan. Also in the same city from where I am accessing. Not sure if those servers have R2.

Isaac McFadyen•10/14/23, 6:25 PM

Cloudflare doesn't publicize it's server info (only location info), so not sure where you're getting that info from - but yes, they do have servers in Pakistan. Just not sure they have R2.

IIsaac McFadyen Cloudflare doesn't publicize it's server info (only location info), so not sure ...

ahmedOP•10/14/23, 6:27 PM

https://www.cloudflare.com/network/

I check on this link

Aahmed https://www.cloudflare.com/network/ I check on this link

Isaac McFadyen•10/14/23, 6:28 PM

Oh, makes sense. Those are locations so they may have multiple servers in each one but regardless, R2 isn't directly related to Cloudflare locations.

Isaac McFadyen•10/14/23, 6:28 PM

Some locations will have R2 and some won't and Cloudflare doesn't make which ones public.

import express from 'express'; import multer from 'multer'; import cors from 'cors'; import { S3Client, PutObjectCommand } from '@aws-sdk/client-s3'; import dotenv from 'dotenv'; const app = express(); const port = 4000; app.use(cors()); dotenv.config(); const storage = multer.memoryStorage(); const upload = multer({ storage, }); app.post('/upload', upload.single('file'), async (req, res) => { const S3 = new S3Client({ region: 'auto', endpoint: process.env.ENDPOINT, credentials: { accessKeyId: process.env.R2_ACCESS_KEY_ID, secretAccessKey: process.env.R2_SECRET_ACCESS_KEY, }, }); await S3.send( new PutObjectCommand({ Body: req.file.buffer, Bucket: 'travelme', Key: req.file.originalname, ContentType: req.file.mimetype, }) ); res.send('File Uploaded' + ' ' + req.file.originalname); });

const [file, setFile] = useState(''); const handleChange = (e) => { setFile(e.target.files[0]); }; const handleSubmit = async (e) => { e.preventDefault(); const formData = new FormData(); formData.append('file', file); const response = await fetch('http://localhost:4000/upload', { method: 'POST', body: formData, }); const message = await response.text(); console.log(message); };

What is the difference between R2 and Cache Reserve. My use case is video delivery, around 100 to 1

Similar Threads

Similar Threads

Similar Threads