Are you visiting the direct path to a file? Theres no directory listing function so visiting a direc

EErisa Are you visiting the direct path to a file? Theres no directory listing function...

M

Matt•11/10/23, 12:32 PM

thats excatly what i was doing

sorry new to this.. so there is no way for me to view the files in a bucket.. just a direct link to the file itself?

E

ErisaOP•11/10/23, 12:33 PM

Not with R2 itself, you would have to deploy a Worker that can do it (for the extra cost of worker requests) e.g. there is a popular one https://github.com/kotx/render/

E

ErisaOP•11/10/23, 12:35 PM

Yes

E

ErisaOP•11/10/23, 12:35 PM

Sure but you would have to visit /index.html or add a transform rule to rewrite to it

E

ErisaOP•11/10/23, 12:35 PM

And thats not R2 itself anymore either

E

ErisaOP•11/10/23, 12:40 PM

Yeah

E

ErisaOP•11/10/23, 12:40 PM

Prebaking adds some extra effort when organising and uploading the files, so just a game of tradeoffs as well, good callout

E

ErisaOP•11/10/23, 12:41 PM

Yes, the less simple part is creating and uploading index.html that match all your directories and keeping them updated

E

ErisaOP•11/10/23, 12:56 PM

Great

E

ErisaOP•11/10/23, 12:56 PM

feel free to publish it when youre comfortable doing that, would be a good resource

A

AydinTheFirst•11/10/23, 1:34 PM

hi im using cloudflare r2 with nodejs im uploading files to server and then uploading them to r2 but whenever i upload a file it gets uploaded with mimetype of application/octet-stream the files are correct on my folder

const g_pdf = new PutObjectCommand({
      Bucket: "fristroop",
      Body: pdf.path,
      Key: `halodergisi/dergiler/${pdf.filename}`,
    });
    await storage.send(g_pdf);

const g_pdf = new PutObjectCommand({
      Bucket: "fristroop",
      Body: pdf.path,
      Key: `halodergisi/dergiler/${pdf.filename}`,
    });
    await storage.send(g_pdf);

const g_pdf = new PutObjectCommand({
      Bucket: "fristroop",
      Body: pdf.path,
      Key: `halodergisi/dergiler/${pdf.filename}`,
    });
    await storage.send(g_pdf);

const g_pdf = new PutObjectCommand({
      Bucket: "fristroop",
      Body: pdf.path,
      Key: `halodergisi/dergiler/${pdf.filename}`,
    });
    await storage.send(g_pdf);

A

AydinTheFirst•11/10/23, 1:35 PM

A

AydinTheFirst•11/10/23, 1:36 PM

how ?

A

AydinTheFirst•11/10/23, 1:38 PM

yes

A

AydinTheFirst•11/10/23, 1:38 PM

im making a magazine website

A

AydinTheFirst•11/10/23, 1:38 PM

i need to fetch thumbnail as image/*

A

AydinTheFirst•11/10/23, 1:38 PM

i got same code for thumbnail

A

AydinTheFirst•11/10/23, 1:39 PM

  const g_banner = new PutObjectCommand({
    Bucket: "fristroop",
    Body: banner.path,
    Key: `halodergisi/thumbnails/${banner.filename}`,
    ContentEncoding: banner.mimetype
  });

  const g_banner = new PutObjectCommand({
    Bucket: "fristroop",
    Body: banner.path,
    Key: `halodergisi/thumbnails/${banner.filename}`,
    ContentEncoding: banner.mimetype
  });

  const g_banner = new PutObjectCommand({
    Bucket: "fristroop",
    Body: banner.path,
    Key: `halodergisi/thumbnails/${banner.filename}`,
    ContentEncoding: banner.mimetype
  });

  const g_banner = new PutObjectCommand({
    Bucket: "fristroop",
    Body: banner.path,
    Key: `halodergisi/thumbnails/${banner.filename}`,
    ContentEncoding: banner.mimetype
  });

Original message was deleted

A

AydinTheFirst•11/10/23, 1:40 PM

i added this when i saw that message im testing rn

A

AydinTheFirst•11/10/23, 1:45 PM

thnks

WWakaTime DigitalOcean Spaces has a limit of 500 req/sec per bucket and 1500 req/sec for a...

Z

Zora•11/10/23, 1:46 PM

I see

Original message was deleted

A

AydinTheFirst•11/10/23, 1:48 PM

same error occurs with ContentEncoding

A

AydinTheFirst•11/10/23, 1:50 PM

nwm its not contentEncoding its contentType

A

AydinTheFirst•11/10/23, 1:50 PM

which i need to provide

A

AydinTheFirst•11/10/23, 1:52 PM

hmm

A

AydinTheFirst•11/10/23, 1:52 PM

it still has same issue

A

AydinTheFirst•11/10/23, 1:52 PM

https://cdn.fristroop.com/halodergisi/thumbnails/tets_1699624200812.png

A

AydinTheFirst•11/10/23, 1:52 PM

A

AydinTheFirst•11/10/23, 1:53 PM

https://cdn.fristroop.com/halodergisi/dergiler/tets_1699624200824.pdf

A

AydinTheFirst•11/10/23, 1:53 PM

for pdf tho

A

AydinTheFirst•11/10/23, 1:55 PM

export const uploadFile = async (dest, file) => {
  const command = new PutObjectCommand({
    Bucket: "fristroop",
    Body: file.path,
    Key: `halodergisi/${dest}/${file.filename}`,
    ContentType: file.mimetype,
  });

  await storage.send(command);

  return command;
};

// router.js
  const cmd_banner = await uploadFile("thumbnails", banner);
  const cmd_pdf = await uploadFile("dergiler", pdf);

  const model = await magazineModel.create({
    id: v4(),
    title,
    description,
    catId,
    timestamp: Date.now(),
    thumbnail: cmd_banner.input.Key,
    file: cmd_pdf.input.Key,
  });

export const uploadFile = async (dest, file) => {
  const command = new PutObjectCommand({
    Bucket: "fristroop",
    Body: file.path,
    Key: `halodergisi/${dest}/${file.filename}`,
    ContentType: file.mimetype,
  });

  await storage.send(command);

  return command;
};

// router.js
  const cmd_banner = await uploadFile("thumbnails", banner);
  const cmd_pdf = await uploadFile("dergiler", pdf);

  const model = await magazineModel.create({
    id: v4(),
    title,
    description,
    catId,
    timestamp: Date.now(),
    thumbnail: cmd_banner.input.Key,
    file: cmd_pdf.input.Key,
  });

export const uploadFile = async (dest, file) => {
  const command = new PutObjectCommand({
    Bucket: "fristroop",
    Body: file.path,
    Key: `halodergisi/${dest}/${file.filename}`,
    ContentType: file.mimetype,
  });

  await storage.send(command);

  return command;
};

// router.js
  const cmd_banner = await uploadFile("thumbnails", banner);
  const cmd_pdf = await uploadFile("dergiler", pdf);

  const model = await magazineModel.create({
    id: v4(),
    title,
    description,
    catId,
    timestamp: Date.now(),
    thumbnail: cmd_banner.input.Key,
    file: cmd_pdf.input.Key,
  });

export const uploadFile = async (dest, file) => {
  const command = new PutObjectCommand({
    Bucket: "fristroop",
    Body: file.path,
    Key: `halodergisi/${dest}/${file.filename}`,
    ContentType: file.mimetype,
  });

  await storage.send(command);

  return command;
};

// router.js
  const cmd_banner = await uploadFile("thumbnails", banner);
  const cmd_pdf = await uploadFile("dergiler", pdf);

  const model = await magazineModel.create({
    id: v4(),
    title,
    description,
    catId,
    timestamp: Date.now(),
    thumbnail: cmd_banner.input.Key,
    file: cmd_pdf.input.Key,
  });

D

Dave•11/10/23, 5:33 PM

is R2 able to add metadata for "put object" commands ?

import {
  PutObjectCommand,
  S3Client
} from '@aws-sdk/client-s3';
import { getSignedUrl } from '@aws-sdk/s3-request-presigner';

...

const s3 = new S3Client({ ... });
const cmd = new PutObjectCommand({
  Bucket: c.env.BUCKET_NAME_VAULT_STORAGE,
  Key: fileKey,
  Metadata: {
    test: 'hello',
  },
  ContentType: file.type,
  ContentLength: file.size,
});

const url = await getSignedUrl(s3, cmd, { expiresIn: SIGNATURE_EXPIRATION_IN_SECONDS });

....(front end uploads to url)

import {
  PutObjectCommand,
  S3Client
} from '@aws-sdk/client-s3';
import { getSignedUrl } from '@aws-sdk/s3-request-presigner';

...

const s3 = new S3Client({ ... });
const cmd = new PutObjectCommand({
  Bucket: c.env.BUCKET_NAME_VAULT_STORAGE,
  Key: fileKey,
  Metadata: {
    test: 'hello',
  },
  ContentType: file.type,
  ContentLength: file.size,
});

const url = await getSignedUrl(s3, cmd, { expiresIn: SIGNATURE_EXPIRATION_IN_SECONDS });

....(front end uploads to url)

import {
  PutObjectCommand,
  S3Client
} from '@aws-sdk/client-s3';
import { getSignedUrl } from '@aws-sdk/s3-request-presigner';

...

const s3 = new S3Client({ ... });
const cmd = new PutObjectCommand({
  Bucket: c.env.BUCKET_NAME_VAULT_STORAGE,
  Key: fileKey,
  Metadata: {
    test: 'hello',
  },
  ContentType: file.type,
  ContentLength: file.size,
});

const url = await getSignedUrl(s3, cmd, { expiresIn: SIGNATURE_EXPIRATION_IN_SECONDS });

....(front end uploads to url)

import {
  PutObjectCommand,
  S3Client
} from '@aws-sdk/client-s3';
import { getSignedUrl } from '@aws-sdk/s3-request-presigner';

...

const s3 = new S3Client({ ... });
const cmd = new PutObjectCommand({
  Bucket: c.env.BUCKET_NAME_VAULT_STORAGE,
  Key: fileKey,
  Metadata: {
    test: 'hello',
  },
  ContentType: file.type,
  ContentLength: file.size,
});

const url = await getSignedUrl(s3, cmd, { expiresIn: SIGNATURE_EXPIRATION_IN_SECONDS });

....(front end uploads to url)

as you can see in the screenshot, no metadata was added to the file.

metadata seems to work fine for multipart uploads, but not for single "put object" commands. is it working ok?

Screenshot_2023-11-10_at_12.28.01_PM.png

L

LordWaffl3•11/10/23, 6:42 PM

Hello ,
I have the free 10GB plan
I'm wondering if I'm in excess will I be notified first?

LLordWaffl3 Hello , I have the free 10GB plan I'm wondering if I'm in excess will I be not...

U

Unsmart•11/10/23, 7:13 PM

You can setup a notification to occur after you reach a certain storage amount but if you go over 10GB you will be charged there's no hard limit and no "free" plan there's only a paid plan that has a free tier.

UUnsmart You can setup a notification to occur after you reach a certain storage amount b...

L

LordWaffl3•11/10/23, 8:35 PM

Doo you know where i can find any doccumentation to create this notification alert ?

LLordWaffl3 Doo you know where i can find any doccumentation to create this notification ale...

C

Chaika•11/10/23, 8:41 PM

https://developers.cloudflare.com/notifications/notification-available/
It's a billing alert, you can create it in the dashboard under Notifications -> Add -> Usage Based Billing -> Product R2 Storage

Available Notifications · Cloudflare Notifications docs

Available Notifications depend on your Cloudflare plan. Cloudflare offers a variety of Notifications for our products and services, such as Billing, …

Z

Z•11/11/23, 4:34 AM

In R2, there is a compressed file whose URL is https://123.r2.cloudflarestorage.com/123.zip. I want to add a signature to this URL. When there is no signature in the URL or the signature does not match, the direct link The resource cannot be accessed. How should this requirement be implemented? I read the official documentation, https://developers.cloudflare.com/r2/api/s3/presigned-urls/, but I still don’t know what to do. I hope I can get your help.

ZZ In R2, there is a compressed file whose URL is https://123.r2.cloudflarestorage....

S

Sid•11/11/23, 4:46 AM

Have you looked at the examples for generating presigned URLs linked on the page?

SSid Have you looked at the examples for generating presigned URLs linked on the page...

Z

Z•11/11/23, 4:55 AM

I’ve seen it, but I don’t quite understand how to implement it.

A

ahmed•11/11/23, 10:05 AM

Hi, I have two questions:

1. Is there any difference on the selection of the PoPs to which my user will be served content in Free and Pro tier? I have often seen my requests being served all the way from France servers or other part of the world despite having 3 Cloudflare CDN PoPs in my country Pakistan (one is in my city). Will it make any difference if I switch from Free plan to Pro plan?
2. I have hosted my content on R2, so is my content replicated across Cloudflare regions so that it is served from closest origin in case of cache MISS?

S

snow21•11/11/23, 12:09 PM

I need to write a cloud function to copy a file from google cloud storage to R2 storage. There is a Dart package for accessing any S3 compatible storage but I am wondering if a cloudflare worker could do the file copy more easily than running Dart code in google cloud Run could do it? Can a cloudflare worker do the file copy?

Ssnow21 I need to write a cloud function to copy a file from google cloud storage to R2 ...

H

Hello, I’m Allie!•11/11/23, 12:25 PM

A single file? Multiple files? An entire bucket?

S

snow21•11/11/23, 12:28 PM

Probably something like 20 files at a time, maybe 10 to 20 MB. It will probably happen every few minutes.
@HardlyHolidayin’

S

snow21•11/11/23, 12:29 PM

Or possibly I could bundle the 20 files into one zip file. They all belong together.

Ssnow21 Probably something like 20 files at a time, maybe 10 to 20 MB. It will probably...

H

Hello, I’m Allie!•11/11/23, 12:44 PM

A Worker should be able to handle that then

HHello, I’m Allie!A Worker should be able to handle that then

S

snow21•11/11/23, 12:46 PM

ok, I'm new to cloudflare, is it much work to implement that? What language would it be?

S

snow21•11/11/23, 12:51 PM

Also how would a Worker access a file on google cloud storage and what security rule can I have on google cloud?

Ssnow21 ok, I'm new to cloudflare, is it much work to implement that? What language wou...

H

Hello, I’m Allie!•11/11/23, 12:58 PM

It would be easiest to write it in JavaScript. As for how to access a file on GCS, you should be able to use a library like

aws4fetch

aws4fetch

aws4fetch

aws4fetch to pull the files down

npm

aws4fetch

A compact AWS client for modern JS environments. Latest version: 1.0.17, last published: a year ago. Start using aws4fetch in your project by running

npm i aws4fetch

npm i aws4fetch

npm i aws4fetch

npm i aws4fetch. There are 30 other projects in the npm registry using aws4fetch.

Are you visiting the direct path to a file? Theres no directory listing function so visiting a direc

Similar Threads

Similar Threads

Similar Threads