Hey guys asking this again cuz I think it got lost earlier - what’s the best practice for setting up

Hey guys asking this again cuz I think it got lost earlier - what’s the best practice for setting up multiple public buckets to serve the same web application? As I understand it, you can’t create multiple buckets for the same custom domain name?

Iizdi Is it possible to access via API how many READS or WRITES a bucket had over some...

digitalpoint•10/11/23, 1:41 PM

You can do it with GraphQL. Since GraphQL isn’t just for that (or even just for R2 for that matter), you will need to craft your query to pull the info you are looking for.

https://developers.cloudflare.com/analytics/graphql-api/

You can get counts of various operations with GraphQL. They aren’t strictly read or write operations, so you can choose which you consider read/write if they differ from class A/class B operations. You can see a list of different operation types here:

https://developers.cloudflare.com/r2/pricing/#class-a-operations

GraphQL Analytics API · Cloudflare Analytics docs

The GraphQL Analytics API provides data regarding HTTP requests passing through Cloudflare’s network, as well as data from specific products, such as …

Pricing · Cloudflare R2 docs

R2 charges based on the total volume of data stored, along with two classes of operations on that data:

ZETABLACK•10/11/23, 2:00 PM

Hi. I am very fun to join this channel.

Recently, I started to use Cloudflare R2 instead of AWS S3. Your service is very good!

Now, I have a question. If I uploaded "111111111/images/namihei.jpg" into bucket and make it public with CORS setting, I can show this image only writing this url in a html.

src="https://XX.r2.cloudflare.com/111111111/images/namihei.jpg"

But, if possible, I would like to hide this url since it includes user id "111111111" in the path (To manage the file easily, this information is necessary). I would like to write

src="https://XX.r2.cloudflare.com/hufhsehvnkenoihviknreb"

and make it possible to download the "namihei.jpg" file.

If R2 has a function to issue alternative url to download the file, I hope you to share how to do it.

Kirmola•10/11/23, 3:01 PM

Is upload_file method of boto implemented in R2 as I am dealing with direct file upload to R2?

Thanyaporn Pongpinij•10/11/23, 3:40 PM

Hello I have a little confusing in cloudflare r2 pricing

Thanyaporn Pongpinij•10/11/23, 3:41 PM

or I need to pay 4.5$ and 0.36$ even if I'm not use more than the limit?

Unsmart•10/11/23, 3:52 PM

if you use less than the free then you wont pay

UUnsmart if you use less than the free then you wont pay

Thanyaporn Pongpinij•10/11/23, 4:07 PM

Okay thanks you

Thanyaporn Pongpinij•10/11/23, 4:08 PM

so why some of my friend need to pay Cache reserve?

Thanyaporn Pongpinij•10/11/23, 4:08 PM

Unsmart•10/11/23, 4:08 PM

Cache reserve is a different product without any free tier

BBrammy Any idea on what the best way is to migrate from Digital Ocean's spaces to R2? S...

Karew•10/11/23, 8:42 PM

Rclone

Zzendev Hey guys asking this again cuz I think it got lost earlier - what’s the best pra...

Karew•10/11/23, 8:45 PM

That’s correct, a custom domain can only be one bucket. You’ll need to use multiple domains, or you might be able to hack it with Redirect Rules or Transform Rules

KKarew That’s correct, a custom domain can only be one bucket. You’ll need to use multi...

zendevOP•10/11/23, 9:52 PM

I see - is there any reason to use multiple buckets in the first place? Should I just store everything in one bucket?

Zzendev I see - is there any reason to use multiple buckets in the first place? Should I...

Karew•10/11/23, 10:49 PM

It really depends on your app design. Usually you want to separate concerns. User content, logs, product images.

Karew•10/11/23, 10:49 PM

If your whole app is about uploading files you might have user uploads in one bucket and stuff like avatars or extra bits in a separate bucket

zendevOP•10/11/23, 10:58 PM

Right this was my initial thinking, which is why I was confused as to why it’s so convoluted to set up multiple public buckets

KKarew It really depends on your app design. Usually you want to separate concerns. Use...

zendevOP•10/11/23, 11:00 PM

I’ll look into subdomains and if that doesn’t work, I’ll check out Transform rules

Planetenabwehrkanonenkommandant•10/12/23, 3:55 AM

Planetenabwehrkanonenkommandant•10/12/23, 3:56 AM

is there a way to use a single domain for multiple buckets in different locations (eu and us) and redirect the requests based on location?

PPlanetenabwehrkanonenkommandant is there a way to use a single domain for multiple buckets in different location...

Anu•10/12/23, 6:48 AM

Hey, you can create buckets in different locations but then you need to have a script to redirect requests

Anu•10/12/23, 6:49 AM

Hi there! When uploading files to R2 bucket via Cloudflare GUI it has a limit of 300MB or similar. I can guess why you have that limit but I would appreciate if you could confirm and provide some insights about it

AAnu Hi there! When uploading files to R2 bucket via Cloudflare GUI it has a limit of...

Anu•10/12/23, 6:52 AM

OK, ignore it, I found it here https://discord.com/channels/595317990191398933/812577823599755274/1152432568147386508

shaep778•10/12/23, 11:02 AM

For R2 Sippy migration that's in beta, how does that work exactly? Trying to understand costs on the S3 side

is the R2 bucket listable with all the S3 objects? so, is there a LIST operation run when I active Sippy to get details of every object in the S3 bucket, and is it kept in sync somehow?
OR is there no LIST operations, I see nothing in the R2 bucket, but when I sync something with same key as S3, it'll transfer over that object to R2 and then make it visible on the R2 side?

Does that make sense? I'm not very familiar with all the specific terms of R2/S3, so sorry if that's confusing

shaep778•10/12/23, 11:03 AM

Also, with the Super Slurper Migration, can I define multiple "sub path"s in one migration job?

shaep778•10/12/23, 11:09 AM

If not, is there a way for me to queue up migration jobs?

Sshaep778 For R2 Sippy migration that's in beta, how does that work exactly? Trying to und...

Karew•10/12/23, 11:44 AM

With Sippy on, listing R2 will just show what has currently been brought over (so your second bullet)

Karew•10/12/23, 11:44 AM

You can monitor the R2 bucket as it’s being filled

m0jo•10/12/23, 12:07 PM

not sure who the dev is for R2 Explorer, but I wanted to ask if its possible to change the way R2 Explorer looks on the page

m0jo•10/12/23, 12:08 PM

for example, change the title to be anything you want

KKarew With Sippy on, listing R2 will just show what has currently been brought over (s...

shaep778•10/12/23, 2:44 PM

thanks a lot!

shaep778•10/12/23, 2:44 PM

Any ideas about doing defining multiple subpaths or queuing migrations with Super Slurper?

KKarew With Sippy on, listing R2 will just show what has currently been brought over (s...

shaep778•10/12/23, 2:45 PM

so just to be sure... we won't pay for any LIST requests on s3, just GET request + egress cost per object when we ask for a object from R2 for the first time?

ahmed•10/12/23, 3:05 PM

What is the difference between R2 and Cache Reserve.

My use case is video delivery, around 100 to 120 TB per month. Currently, I have my video files on Wasabi. As per my understanding, Cache Reserve will fetch files automatically from my origin and store it permanently (on R2 itself), and in case I go with R2, I will have to upload files myself and it would same as storing files as on Wasabi. I want to understand the difference in the delivery of R2 and Cache Reserve, is it same CDN distributed globally or R2 is just a storage with free egress and requires a CDN separately for delivering 100+ TB of video content?

Aahmed What is the difference between R2 and Cache Reserve. My use case is video deliv...

Hello, I’m Allie!•10/12/23, 3:14 PM

You would basically be paying twice the storage costs if you used Wasabi+Cache Reserve. Plus, lower-accessed objects may be evicted from Cache Reserve after 30 days. I would go with R2

HHello, I’m Allie!You would basically be paying twice the storage costs if you used Wasabi+Cache R...

ahmed•10/12/23, 3:15 PM

So R2 also uses Cloudflare CDN? Is it good for video delivery?

Aahmed So R2 also uses Cloudflare CDN? Is it good for video delivery?

Hello, I’m Allie!•10/12/23, 3:15 PM

Yes

starina_cool•10/12/23, 4:30 PM

This happens when I turn Cache reserve on. It looks that it takes a lot of time to save file to R2 bucket.

Admir•10/12/23, 5:05 PM

I am uploading images from my react website to R2, everything is sucesfull but now i want to retrive the url of the uploaded image, any advice is welcome

import express from 'express';
import multer from 'multer';
import cors from 'cors';
import { S3Client, PutObjectCommand } from '@aws-sdk/client-s3';
import dotenv from 'dotenv';

const app = express();
const port = 4000;
app.use(cors());
dotenv.config();

const storage = multer.memoryStorage();
const upload = multer({
  storage,
});

app.post('/upload', upload.single('file'), async (req, res) => {
  const S3 = new S3Client({
    region: 'auto',
    endpoint: process.env.ENDPOINT,
    credentials: {
      accessKeyId: process.env.R2_ACCESS_KEY_ID,
      secretAccessKey: process.env.R2_SECRET_ACCESS_KEY,
    },
  });

  await S3.send(
    new PutObjectCommand({
      Body: req.file.buffer,
      Bucket: 'travelme',
      Key: req.file.originalname,
      ContentType: req.file.mimetype,
    })
  );
  res.send('File Uploaded' + ' ' + req.file.originalname);
});

import express from 'express';
import multer from 'multer';
import cors from 'cors';
import { S3Client, PutObjectCommand } from '@aws-sdk/client-s3';
import dotenv from 'dotenv';

const app = express();
const port = 4000;
app.use(cors());
dotenv.config();

const storage = multer.memoryStorage();
const upload = multer({
  storage,
});

app.post('/upload', upload.single('file'), async (req, res) => {
  const S3 = new S3Client({
    region: 'auto',
    endpoint: process.env.ENDPOINT,
    credentials: {
      accessKeyId: process.env.R2_ACCESS_KEY_ID,
      secretAccessKey: process.env.R2_SECRET_ACCESS_KEY,
    },
  });

  await S3.send(
    new PutObjectCommand({
      Body: req.file.buffer,
      Bucket: 'travelme',
      Key: req.file.originalname,
      ContentType: req.file.mimetype,
    })
  );
  res.send('File Uploaded' + ' ' + req.file.originalname);
});

and in my react

  const [file, setFile] = useState('');

  const handleChange = (e) => {
    setFile(e.target.files[0]);
  };

  const handleSubmit = async (e) => {
    e.preventDefault();
    const formData = new FormData();
    formData.append('file', file);
    const response = await fetch('http://localhost:4000/upload', {
      method: 'POST',
      body: formData,
    });

    const message = await response.text();
    console.log(message);
  };

  const [file, setFile] = useState('');

  const handleChange = (e) => {
    setFile(e.target.files[0]);
  };

  const handleSubmit = async (e) => {
    e.preventDefault();
    const formData = new FormData();
    formData.append('file', file);
    const response = await fetch('http://localhost:4000/upload', {
      method: 'POST',
      body: formData,
    });

    const message = await response.text();
    console.log(message);
  };

AAdmir I am uploading images from my react website to R2, everything is sucesfull but n...

digitalpoint•10/12/23, 5:09 PM

The URL is going to be based on the key (which is what looks like a path/filename normally) you upload the file as. If it's a public bucket (with a public domain as

images.yourdomain.com

images.yourdomain.com

), and you upload an image with a key of

something/image.png

something/image.png

, the URL would be https://images.yourdomain.com/something/image.png

Ddigitalpoint The URL is going to be based on the key (which is what looks like a path/filenam...

Admir•10/12/23, 5:14 PM

thank you, it works

Austin B•10/12/23, 6:16 PM

~~I'm looking to try out SIppy on a bucket; what permissions are required on the CloudFlare API token to enable this? I can't find that in the documentation anywhere. Thanks!~~

Found it. It is the

Account.Workers R2 Storage

Account.Workers R2 Storage

permission that is required to set it up.

HHello, I’m Allie!Yes

ahmed•10/12/23, 6:21 PM

Are cached requests counted as Class B operations?

Aahmed Are cached requests counted as Class B operations?

Hello, I’m Allie!•10/12/23, 6:22 PM

Nope

Hello, I’m Allie!•10/12/23, 6:22 PM

As long as a request is cacheable(below the size limit, etc.)

Sshaep778 so just to be sure... we won't pay for any LIST requests on s3, just GET request...

Karew•10/12/23, 6:36 PM

Right, it shouldn't be listing your S3 bucket, it should only be checking for individual items

import express from 'express'; import multer from 'multer'; import cors from 'cors'; import { S3Client, PutObjectCommand } from '@aws-sdk/client-s3'; import dotenv from 'dotenv'; const app = express(); const port = 4000; app.use(cors()); dotenv.config(); const storage = multer.memoryStorage(); const upload = multer({ storage, }); app.post('/upload', upload.single('file'), async (req, res) => { const S3 = new S3Client({ region: 'auto', endpoint: process.env.ENDPOINT, credentials: { accessKeyId: process.env.R2_ACCESS_KEY_ID, secretAccessKey: process.env.R2_SECRET_ACCESS_KEY, }, }); await S3.send( new PutObjectCommand({ Body: req.file.buffer, Bucket: 'travelme', Key: req.file.originalname, ContentType: req.file.mimetype, }) ); res.send('File Uploaded' + ' ' + req.file.originalname); });

const [file, setFile] = useState(''); const handleChange = (e) => { setFile(e.target.files[0]); }; const handleSubmit = async (e) => { e.preventDefault(); const formData = new FormData(); formData.append('file', file); const response = await fetch('http://localhost:4000/upload', { method: 'POST', body: formData, }); const message = await response.text(); console.log(message); };

Hey guys asking this again cuz I think it got lost earlier - what’s the best practice for setting up

Similar Threads