Cloudflare Developers•3y ago

I see - is there any reason to use multiple buckets in the first place? Should I just store everythi

I see - is there any reason to use multiple buckets in the first place? Should I just store everything in one bucket?

Zzendev I see - is there any reason to use multiple buckets in the first place? Should I...

Karew•10/11/23, 10:49 PM

It really depends on your app design. Usually you want to separate concerns. User content, logs, product images.

Karew•10/11/23, 10:49 PM

If your whole app is about uploading files you might have user uploads in one bucket and stuff like avatars or extra bits in a separate bucket

zendevOP•10/11/23, 10:58 PM

Right this was my initial thinking, which is why I was confused as to why it’s so convoluted to set up multiple public buckets

KKarew It really depends on your app design. Usually you want to separate concerns. Use...

zendevOP•10/11/23, 11:00 PM

I’ll look into subdomains and if that doesn’t work, I’ll check out Transform rules

Planetenabwehrkanonenkommandant•10/12/23, 3:55 AM

Planetenabwehrkanonenkommandant•10/12/23, 3:56 AM

is there a way to use a single domain for multiple buckets in different locations (eu and us) and redirect the requests based on location?

PPlanetenabwehrkanonenkommandant is there a way to use a single domain for multiple buckets in different location...

Anu•10/12/23, 6:48 AM

Hey, you can create buckets in different locations but then you need to have a script to redirect requests

Anu•10/12/23, 6:49 AM

Hi there! When uploading files to R2 bucket via Cloudflare GUI it has a limit of 300MB or similar. I can guess why you have that limit but I would appreciate if you could confirm and provide some insights about it

AAnu Hi there! When uploading files to R2 bucket via Cloudflare GUI it has a limit of...

Anu•10/12/23, 6:52 AM

OK, ignore it, I found it here https://discord.com/channels/595317990191398933/812577823599755274/1152432568147386508

shaep778•10/12/23, 11:02 AM

For R2 Sippy migration that's in beta, how does that work exactly? Trying to understand costs on the S3 side

is the R2 bucket listable with all the S3 objects? so, is there a LIST operation run when I active Sippy to get details of every object in the S3 bucket, and is it kept in sync somehow?
OR is there no LIST operations, I see nothing in the R2 bucket, but when I sync something with same key as S3, it'll transfer over that object to R2 and then make it visible on the R2 side?

Does that make sense? I'm not very familiar with all the specific terms of R2/S3, so sorry if that's confusing

shaep778•10/12/23, 11:03 AM

Also, with the Super Slurper Migration, can I define multiple "sub path"s in one migration job?

shaep778•10/12/23, 11:09 AM

If not, is there a way for me to queue up migration jobs?

Sshaep778 For R2 Sippy migration that's in beta, how does that work exactly? Trying to und...

Karew•10/12/23, 11:44 AM

With Sippy on, listing R2 will just show what has currently been brought over (so your second bullet)

Karew•10/12/23, 11:44 AM

You can monitor the R2 bucket as it’s being filled

m0jo•10/12/23, 12:07 PM

not sure who the dev is for R2 Explorer, but I wanted to ask if its possible to change the way R2 Explorer looks on the page

m0jo•10/12/23, 12:08 PM

for example, change the title to be anything you want

KKarew With Sippy on, listing R2 will just show what has currently been brought over (s...

shaep778•10/12/23, 2:44 PM

thanks a lot!

shaep778•10/12/23, 2:44 PM

Any ideas about doing defining multiple subpaths or queuing migrations with Super Slurper?

KKarew With Sippy on, listing R2 will just show what has currently been brought over (s...

shaep778•10/12/23, 2:45 PM

so just to be sure... we won't pay for any LIST requests on s3, just GET request + egress cost per object when we ask for a object from R2 for the first time?

ahmed•10/12/23, 3:05 PM

What is the difference between R2 and Cache Reserve.

My use case is video delivery, around 100 to 120 TB per month. Currently, I have my video files on Wasabi. As per my understanding, Cache Reserve will fetch files automatically from my origin and store it permanently (on R2 itself), and in case I go with R2, I will have to upload files myself and it would same as storing files as on Wasabi. I want to understand the difference in the delivery of R2 and Cache Reserve, is it same CDN distributed globally or R2 is just a storage with free egress and requires a CDN separately for delivering 100+ TB of video content?

Aahmed What is the difference between R2 and Cache Reserve. My use case is video deliv...

Hello, I’m Allie!•10/12/23, 3:14 PM

You would basically be paying twice the storage costs if you used Wasabi+Cache Reserve. Plus, lower-accessed objects may be evicted from Cache Reserve after 30 days. I would go with R2

HHello, I’m Allie!You would basically be paying twice the storage costs if you used Wasabi+Cache R...

ahmed•10/12/23, 3:15 PM

So R2 also uses Cloudflare CDN? Is it good for video delivery?

Aahmed So R2 also uses Cloudflare CDN? Is it good for video delivery?

Hello, I’m Allie!•10/12/23, 3:15 PM

Yes

starina_cool•10/12/23, 4:30 PM

This happens when I turn Cache reserve on. It looks that it takes a lot of time to save file to R2 bucket.

Admir•10/12/23, 5:05 PM

I am uploading images from my react website to R2, everything is sucesfull but now i want to retrive the url of the uploaded image, any advice is welcome

import express from 'express';
import multer from 'multer';
import cors from 'cors';
import { S3Client, PutObjectCommand } from '@aws-sdk/client-s3';
import dotenv from 'dotenv';

const app = express();
const port = 4000;
app.use(cors());
dotenv.config();

const storage = multer.memoryStorage();
const upload = multer({
  storage,
});

app.post('/upload', upload.single('file'), async (req, res) => {
  const S3 = new S3Client({
    region: 'auto',
    endpoint: process.env.ENDPOINT,
    credentials: {
      accessKeyId: process.env.R2_ACCESS_KEY_ID,
      secretAccessKey: process.env.R2_SECRET_ACCESS_KEY,
    },
  });

  await S3.send(
    new PutObjectCommand({
      Body: req.file.buffer,
      Bucket: 'travelme',
      Key: req.file.originalname,
      ContentType: req.file.mimetype,
    })
  );
  res.send('File Uploaded' + ' ' + req.file.originalname);
});

import express from 'express';
import multer from 'multer';
import cors from 'cors';
import { S3Client, PutObjectCommand } from '@aws-sdk/client-s3';
import dotenv from 'dotenv';

const app = express();
const port = 4000;
app.use(cors());
dotenv.config();

const storage = multer.memoryStorage();
const upload = multer({
  storage,
});

app.post('/upload', upload.single('file'), async (req, res) => {
  const S3 = new S3Client({
    region: 'auto',
    endpoint: process.env.ENDPOINT,
    credentials: {
      accessKeyId: process.env.R2_ACCESS_KEY_ID,
      secretAccessKey: process.env.R2_SECRET_ACCESS_KEY,
    },
  });

  await S3.send(
    new PutObjectCommand({
      Body: req.file.buffer,
      Bucket: 'travelme',
      Key: req.file.originalname,
      ContentType: req.file.mimetype,
    })
  );
  res.send('File Uploaded' + ' ' + req.file.originalname);
});

and in my react

  const [file, setFile] = useState('');

  const handleChange = (e) => {
    setFile(e.target.files[0]);
  };

  const handleSubmit = async (e) => {
    e.preventDefault();
    const formData = new FormData();
    formData.append('file', file);
    const response = await fetch('http://localhost:4000/upload', {
      method: 'POST',
      body: formData,
    });

    const message = await response.text();
    console.log(message);
  };

  const [file, setFile] = useState('');

  const handleChange = (e) => {
    setFile(e.target.files[0]);
  };

  const handleSubmit = async (e) => {
    e.preventDefault();
    const formData = new FormData();
    formData.append('file', file);
    const response = await fetch('http://localhost:4000/upload', {
      method: 'POST',
      body: formData,
    });

    const message = await response.text();
    console.log(message);
  };

AAdmir I am uploading images from my react website to R2, everything is sucesfull but n...

digitalpoint•10/12/23, 5:09 PM

The URL is going to be based on the key (which is what looks like a path/filename normally) you upload the file as. If it's a public bucket (with a public domain as

images.yourdomain.com

images.yourdomain.com

), and you upload an image with a key of

something/image.png

something/image.png

, the URL would be https://images.yourdomain.com/something/image.png

Ddigitalpoint The URL is going to be based on the key (which is what looks like a path/filenam...

Admir•10/12/23, 5:14 PM

thank you, it works

Austin B•10/12/23, 6:16 PM

~~I'm looking to try out SIppy on a bucket; what permissions are required on the CloudFlare API token to enable this? I can't find that in the documentation anywhere. Thanks!~~

Found it. It is the

Account.Workers R2 Storage

Account.Workers R2 Storage

permission that is required to set it up.

HHello, I’m Allie!Yes

ahmed•10/12/23, 6:21 PM

Are cached requests counted as Class B operations?

Aahmed Are cached requests counted as Class B operations?

Hello, I’m Allie!•10/12/23, 6:22 PM

Nope

Hello, I’m Allie!•10/12/23, 6:22 PM

As long as a request is cacheable(below the size limit, etc.)

Sshaep778 so just to be sure... we won't pay for any LIST requests on s3, just GET request...

Karew•10/12/23, 6:36 PM

Right, it shouldn't be listing your S3 bucket, it should only be checking for individual items

Mmojmir3090 Hey there. I have a CF worker who's fetching data from R2 through bindings. Is t...

Karew•10/12/23, 9:27 PM

If you take advantage of the cache you can conserve transactions from R2

Old Man Maker•10/13/23, 5:26 AM

hi - I'm getting a CORS error on an R2 bucket that is making no sense to me (I'm sure it's my understanding that is wrong though)

I have edited my CORS settings as shown in the image and can access items from the bucket from other apps.

I am getting this error:
Access to fetch at '<BUCKET-ASSET>' from origin 'http://localhost:8080' has been blocked by CORS policy: The 'Access-Control-Allow-Origin' header has a value 'http://localhost:8081' that is not equal to the supplied origin. Have the server send the header with a valid value, or, if an opaque response serves your needs, set the request's mode to 'no-cors' to fetch the resource with CORS disabled.

What does that error even mean? Is Chrome sending the wrong URL in the header, or is CF sending back a different URL?

Any thoughts would be really appreciated

RRicardas Hi, anyone experiencing issues with Reading and Writing to R2 using @aws-sdk/cli...

Karew•10/13/23, 7:56 AM

Did your R2 token expire?

Palash Bansal•10/13/23, 8:54 AM

Hello, is there anything similar to Worker Routes but for r2? i.e mapping a route within a domain instead of the entire domain or subdomain to a R2 bucket without having a worker in the middle.

maurus•10/13/23, 9:29 AM

I just created a new R2 bucket within the EU jurisdiction, but the dashboard is showing internal errors (code 10001) for the policy endpoint. If I create a bucket with an automatic location, this does not happen. Is this a known issue?

kian•10/13/23, 12:48 PM

Yes

OOld Man Maker hi - I'm getting a CORS error on an R2 bucket that is making no sense to me (I'm...

Old Man Maker•10/13/23, 1:01 PM

Still no solution for this?

HHello, I’m Allie!As long as a request is cacheable(below the size limit, etc.)

ahmed•10/14/23, 3:02 PM

What is the size limit? Also, is there any difference in caching on different plans?

Aahmed What is the size limit? Also, is there any difference in caching on different pl...

Hello, I’m Allie!•10/14/23, 3:25 PM

Free, Pro and Business customers have a limit of 512 MB.
For Enterprise customers the default maximum cacheable file size is 5 GB. Contact your account team to request a limit increase.

- Default Cache Behavior

Default Cache Behavior · Cloudflare Cache (CDN) docs

Cloudflare respects the origin web server’s cache headers in the following order unless an Edge Cache TTL page rule overrides the headers.

HHello, I’m Allie!> Free, Pro and Business customers have a limit of 512 MB. > For Enterprise cust...

ahmed•10/14/23, 3:41 PM

Thanks. I am looking for the difference in network quality or other similar factors that may affect experience of the user in terms of performance for different plans. I didn’t find anything on that in the docs.
My use case is video delivery (HLS), video segments would be stored in Cloudflare R2. The video files are broken into many chunks of 10 seconds, so it would be many small files. I want to know if it would make any difference in performance based on plans?

ahmed•10/14/23, 4:47 PM

Very slow file download performance on R2, Cache connected but it was a cache MISS. Accessing from Karachi, PK. What could be the reason?

Aahmed Very slow file download performance on R2, Cache connected but it was a cache MI...

ahmed•10/14/23, 4:49 PM

Aahmed Click to see attachment

Isaac McFadyen•10/14/23, 6:10 PM

Cloudflare IPs are anycast so that IP address isn't actually in California, it's advertised all over the world and then people connect to the closest one. The IP won't be the issue.

import express from 'express'; import multer from 'multer'; import cors from 'cors'; import { S3Client, PutObjectCommand } from '@aws-sdk/client-s3'; import dotenv from 'dotenv'; const app = express(); const port = 4000; app.use(cors()); dotenv.config(); const storage = multer.memoryStorage(); const upload = multer({ storage, }); app.post('/upload', upload.single('file'), async (req, res) => { const S3 = new S3Client({ region: 'auto', endpoint: process.env.ENDPOINT, credentials: { accessKeyId: process.env.R2_ACCESS_KEY_ID, secretAccessKey: process.env.R2_SECRET_ACCESS_KEY, }, }); await S3.send( new PutObjectCommand({ Body: req.file.buffer, Bucket: 'travelme', Key: req.file.originalname, ContentType: req.file.mimetype, }) ); res.send('File Uploaded' + ' ' + req.file.originalname); });

const [file, setFile] = useState(''); const handleChange = (e) => { setFile(e.target.files[0]); }; const handleSubmit = async (e) => { e.preventDefault(); const formData = new FormData(); formData.append('file', file); const response = await fetch('http://localhost:4000/upload', { method: 'POST', body: formData, }); const message = await response.text(); console.log(message); };

I see - is there any reason to use multiple buckets in the first place? Should I just store everythi

Similar Threads