DigitalOcean Spaces has a limit of 500 req/sec per bucket and 1500 req/sec for all buckets.. so only

M

Migmac•11/10/23, 9:25 AM

Question: Is there a way I can generate a presigned url with a custom Content-Disposition header?

Something like this?

const r2 = new AwsClient({
  accessKeyId: env.CF_ACCESS_KEY_ID,
  secretAccessKey: env.CF_ACCESS_KEY_SECRET,
})

const url = new URL(`https://${env.BUCKET_NAME}.${env.CF_ACCOUNT_ID}.r2.cloudflarestorage.com`)

url.pathname = obj.path
url.searchParams.set('X-Amz-Expires', `${60 * 60 * 24 * env.STRUCTURE_EXPIRY}`)

const _signed = await r2.sign(new Request(url, { 
  method: 'GET',
  contentDisposition: `attachment; filename="${obj.name}"`, // <------------------------ Something like this?
}), { aws: { signQuery: true } })
const signed = _signed.url

const r2 = new AwsClient({
  accessKeyId: env.CF_ACCESS_KEY_ID,
  secretAccessKey: env.CF_ACCESS_KEY_SECRET,
})

const url = new URL(`https://${env.BUCKET_NAME}.${env.CF_ACCOUNT_ID}.r2.cloudflarestorage.com`)

url.pathname = obj.path
url.searchParams.set('X-Amz-Expires', `${60 * 60 * 24 * env.STRUCTURE_EXPIRY}`)

const _signed = await r2.sign(new Request(url, { 
  method: 'GET',
  contentDisposition: `attachment; filename="${obj.name}"`, // <------------------------ Something like this?
}), { aws: { signQuery: true } })
const signed = _signed.url

const r2 = new AwsClient({
  accessKeyId: env.CF_ACCESS_KEY_ID,
  secretAccessKey: env.CF_ACCESS_KEY_SECRET,
})

const url = new URL(`https://${env.BUCKET_NAME}.${env.CF_ACCOUNT_ID}.r2.cloudflarestorage.com`)

url.pathname = obj.path
url.searchParams.set('X-Amz-Expires', `${60 * 60 * 24 * env.STRUCTURE_EXPIRY}`)

const _signed = await r2.sign(new Request(url, { 
  method: 'GET',
  contentDisposition: `attachment; filename="${obj.name}"`, // <------------------------ Something like this?
}), { aws: { signQuery: true } })
const signed = _signed.url

const r2 = new AwsClient({
  accessKeyId: env.CF_ACCESS_KEY_ID,
  secretAccessKey: env.CF_ACCESS_KEY_SECRET,
})

const url = new URL(`https://${env.BUCKET_NAME}.${env.CF_ACCOUNT_ID}.r2.cloudflarestorage.com`)

url.pathname = obj.path
url.searchParams.set('X-Amz-Expires', `${60 * 60 * 24 * env.STRUCTURE_EXPIRY}`)

const _signed = await r2.sign(new Request(url, { 
  method: 'GET',
  contentDisposition: `attachment; filename="${obj.name}"`, // <------------------------ Something like this?
}), { aws: { signQuery: true } })
const signed = _signed.url

K

kian•11/10/23, 9:27 AM

Provide it in the headers for RequestInit.

K

kian•11/10/23, 9:28 AM

new Request(url, {
  headers: {
    'content-disposition': `attachment; filename="${obj.name}"`
  }
})

new Request(url, {
  headers: {
    'content-disposition': `attachment; filename="${obj.name}"`
  }
})

new Request(url, {
  headers: {
    'content-disposition': `attachment; filename="${obj.name}"`
  }
})

new Request(url, {
  headers: {
    'content-disposition': `attachment; filename="${obj.name}"`
  }
})

K

kian•11/10/23, 9:29 AM

you'd probably want to add

allHeaders: true

allHeaders: true

allHeaders: true

allHeaders: true into the

aws

aws

aws

aws block as well, next to

signQuery: true

signQuery: true

signQuery: true

signQuery: true

K

kian•11/10/23, 9:29 AM

that only signs it though - the client still has to provide it in the request

M

Migmac•11/10/23, 9:43 AM

Awesome! Thank you @kian

=]

=]

=]

=]

N

NestarZ•11/10/23, 11:56 AM

Hello !
Question: any way to assign a custom domain to a R2 bucket using the wrangler command line tool ?

N

NestarZ•11/10/23, 11:57 AM

Or some script that doesnt involve the web dashboard ?

M

Matt•11/10/23, 12:18 PM

Hi, quick question... if I've followed the steps to create a publicly accessible bucket... and everything looks "good": Public URL Access is Allowed, even threw in a test folder and file to make sure there is something there.. but I can't get in

E

Erisa•11/10/23, 12:22 PM

Are you visiting the direct path to a file? Theres no directory listing function so visiting a directory or the root / wont work

EErisa Are you visiting the direct path to a file? Theres no directory listing function...

M

Matt•11/10/23, 12:32 PM

thats excatly what i was doing

sorry new to this.. so there is no way for me to view the files in a bucket.. just a direct link to the file itself?

E

Erisa•11/10/23, 12:33 PM

Not with R2 itself, you would have to deploy a Worker that can do it (for the extra cost of worker requests) e.g. there is a popular one https://github.com/kotx/render/

E

Erisa•11/10/23, 12:35 PM

Yes

E

Erisa•11/10/23, 12:35 PM

Sure but you would have to visit /index.html or add a transform rule to rewrite to it

E

Erisa•11/10/23, 12:35 PM

And thats not R2 itself anymore either

E

Erisa•11/10/23, 12:40 PM

Yeah

E

Erisa•11/10/23, 12:40 PM

Prebaking adds some extra effort when organising and uploading the files, so just a game of tradeoffs as well, good callout

E

Erisa•11/10/23, 12:41 PM

Yes, the less simple part is creating and uploading index.html that match all your directories and keeping them updated

E

Erisa•11/10/23, 12:56 PM

Great

E

Erisa•11/10/23, 12:56 PM

feel free to publish it when youre comfortable doing that, would be a good resource

A

AydinTheFirst•11/10/23, 1:34 PM

hi im using cloudflare r2 with nodejs im uploading files to server and then uploading them to r2 but whenever i upload a file it gets uploaded with mimetype of application/octet-stream the files are correct on my folder

const g_pdf = new PutObjectCommand({
      Bucket: "fristroop",
      Body: pdf.path,
      Key: `halodergisi/dergiler/${pdf.filename}`,
    });
    await storage.send(g_pdf);

const g_pdf = new PutObjectCommand({
      Bucket: "fristroop",
      Body: pdf.path,
      Key: `halodergisi/dergiler/${pdf.filename}`,
    });
    await storage.send(g_pdf);

const g_pdf = new PutObjectCommand({
      Bucket: "fristroop",
      Body: pdf.path,
      Key: `halodergisi/dergiler/${pdf.filename}`,
    });
    await storage.send(g_pdf);

const g_pdf = new PutObjectCommand({
      Bucket: "fristroop",
      Body: pdf.path,
      Key: `halodergisi/dergiler/${pdf.filename}`,
    });
    await storage.send(g_pdf);

A

AydinTheFirst•11/10/23, 1:35 PM

A

AydinTheFirst•11/10/23, 1:36 PM

how ?

A

AydinTheFirst•11/10/23, 1:38 PM

yes

A

AydinTheFirst•11/10/23, 1:38 PM

im making a magazine website

A

AydinTheFirst•11/10/23, 1:38 PM

i need to fetch thumbnail as image/*

A

AydinTheFirst•11/10/23, 1:38 PM

i got same code for thumbnail

A

AydinTheFirst•11/10/23, 1:39 PM

  const g_banner = new PutObjectCommand({
    Bucket: "fristroop",
    Body: banner.path,
    Key: `halodergisi/thumbnails/${banner.filename}`,
    ContentEncoding: banner.mimetype
  });

  const g_banner = new PutObjectCommand({
    Bucket: "fristroop",
    Body: banner.path,
    Key: `halodergisi/thumbnails/${banner.filename}`,
    ContentEncoding: banner.mimetype
  });

  const g_banner = new PutObjectCommand({
    Bucket: "fristroop",
    Body: banner.path,
    Key: `halodergisi/thumbnails/${banner.filename}`,
    ContentEncoding: banner.mimetype
  });

  const g_banner = new PutObjectCommand({
    Bucket: "fristroop",
    Body: banner.path,
    Key: `halodergisi/thumbnails/${banner.filename}`,
    ContentEncoding: banner.mimetype
  });

Original message was deleted

A

AydinTheFirst•11/10/23, 1:40 PM

i added this when i saw that message im testing rn

A

AydinTheFirst•11/10/23, 1:45 PM

thnks

WWakaTime DigitalOcean Spaces has a limit of 500 req/sec per bucket and 1500 req/sec for a...

Z

Zora•11/10/23, 1:46 PM

I see

Original message was deleted

A

AydinTheFirst•11/10/23, 1:48 PM

same error occurs with ContentEncoding

A

AydinTheFirst•11/10/23, 1:50 PM

nwm its not contentEncoding its contentType

A

AydinTheFirst•11/10/23, 1:50 PM

which i need to provide

A

AydinTheFirst•11/10/23, 1:52 PM

hmm

A

AydinTheFirst•11/10/23, 1:52 PM

it still has same issue

A

AydinTheFirst•11/10/23, 1:52 PM

https://cdn.fristroop.com/halodergisi/thumbnails/tets_1699624200812.png

A

AydinTheFirst•11/10/23, 1:52 PM

A

AydinTheFirst•11/10/23, 1:53 PM

https://cdn.fristroop.com/halodergisi/dergiler/tets_1699624200824.pdf

A

AydinTheFirst•11/10/23, 1:53 PM

for pdf tho

A

AydinTheFirst•11/10/23, 1:55 PM

export const uploadFile = async (dest, file) => {
  const command = new PutObjectCommand({
    Bucket: "fristroop",
    Body: file.path,
    Key: `halodergisi/${dest}/${file.filename}`,
    ContentType: file.mimetype,
  });

  await storage.send(command);

  return command;
};

// router.js
  const cmd_banner = await uploadFile("thumbnails", banner);
  const cmd_pdf = await uploadFile("dergiler", pdf);

  const model = await magazineModel.create({
    id: v4(),
    title,
    description,
    catId,
    timestamp: Date.now(),
    thumbnail: cmd_banner.input.Key,
    file: cmd_pdf.input.Key,
  });

export const uploadFile = async (dest, file) => {
  const command = new PutObjectCommand({
    Bucket: "fristroop",
    Body: file.path,
    Key: `halodergisi/${dest}/${file.filename}`,
    ContentType: file.mimetype,
  });

  await storage.send(command);

  return command;
};

// router.js
  const cmd_banner = await uploadFile("thumbnails", banner);
  const cmd_pdf = await uploadFile("dergiler", pdf);

  const model = await magazineModel.create({
    id: v4(),
    title,
    description,
    catId,
    timestamp: Date.now(),
    thumbnail: cmd_banner.input.Key,
    file: cmd_pdf.input.Key,
  });

export const uploadFile = async (dest, file) => {
  const command = new PutObjectCommand({
    Bucket: "fristroop",
    Body: file.path,
    Key: `halodergisi/${dest}/${file.filename}`,
    ContentType: file.mimetype,
  });

  await storage.send(command);

  return command;
};

// router.js
  const cmd_banner = await uploadFile("thumbnails", banner);
  const cmd_pdf = await uploadFile("dergiler", pdf);

  const model = await magazineModel.create({
    id: v4(),
    title,
    description,
    catId,
    timestamp: Date.now(),
    thumbnail: cmd_banner.input.Key,
    file: cmd_pdf.input.Key,
  });

export const uploadFile = async (dest, file) => {
  const command = new PutObjectCommand({
    Bucket: "fristroop",
    Body: file.path,
    Key: `halodergisi/${dest}/${file.filename}`,
    ContentType: file.mimetype,
  });

  await storage.send(command);

  return command;
};

// router.js
  const cmd_banner = await uploadFile("thumbnails", banner);
  const cmd_pdf = await uploadFile("dergiler", pdf);

  const model = await magazineModel.create({
    id: v4(),
    title,
    description,
    catId,
    timestamp: Date.now(),
    thumbnail: cmd_banner.input.Key,
    file: cmd_pdf.input.Key,
  });

D

Dave•11/10/23, 5:33 PM

is R2 able to add metadata for "put object" commands ?

import {
  PutObjectCommand,
  S3Client
} from '@aws-sdk/client-s3';
import { getSignedUrl } from '@aws-sdk/s3-request-presigner';

...

const s3 = new S3Client({ ... });
const cmd = new PutObjectCommand({
  Bucket: c.env.BUCKET_NAME_VAULT_STORAGE,
  Key: fileKey,
  Metadata: {
    test: 'hello',
  },
  ContentType: file.type,
  ContentLength: file.size,
});

const url = await getSignedUrl(s3, cmd, { expiresIn: SIGNATURE_EXPIRATION_IN_SECONDS });

....(front end uploads to url)

import {
  PutObjectCommand,
  S3Client
} from '@aws-sdk/client-s3';
import { getSignedUrl } from '@aws-sdk/s3-request-presigner';

...

const s3 = new S3Client({ ... });
const cmd = new PutObjectCommand({
  Bucket: c.env.BUCKET_NAME_VAULT_STORAGE,
  Key: fileKey,
  Metadata: {
    test: 'hello',
  },
  ContentType: file.type,
  ContentLength: file.size,
});

const url = await getSignedUrl(s3, cmd, { expiresIn: SIGNATURE_EXPIRATION_IN_SECONDS });

....(front end uploads to url)

import {
  PutObjectCommand,
  S3Client
} from '@aws-sdk/client-s3';
import { getSignedUrl } from '@aws-sdk/s3-request-presigner';

...

const s3 = new S3Client({ ... });
const cmd = new PutObjectCommand({
  Bucket: c.env.BUCKET_NAME_VAULT_STORAGE,
  Key: fileKey,
  Metadata: {
    test: 'hello',
  },
  ContentType: file.type,
  ContentLength: file.size,
});

const url = await getSignedUrl(s3, cmd, { expiresIn: SIGNATURE_EXPIRATION_IN_SECONDS });

....(front end uploads to url)

import {
  PutObjectCommand,
  S3Client
} from '@aws-sdk/client-s3';
import { getSignedUrl } from '@aws-sdk/s3-request-presigner';

...

const s3 = new S3Client({ ... });
const cmd = new PutObjectCommand({
  Bucket: c.env.BUCKET_NAME_VAULT_STORAGE,
  Key: fileKey,
  Metadata: {
    test: 'hello',
  },
  ContentType: file.type,
  ContentLength: file.size,
});

const url = await getSignedUrl(s3, cmd, { expiresIn: SIGNATURE_EXPIRATION_IN_SECONDS });

....(front end uploads to url)

as you can see in the screenshot, no metadata was added to the file.

metadata seems to work fine for multipart uploads, but not for single "put object" commands. is it working ok?

Screenshot_2023-11-10_at_12.28.01_PM.png

L

LordWaffl3•11/10/23, 6:42 PM

Hello ,
I have the free 10GB plan
I'm wondering if I'm in excess will I be notified first?

LLordWaffl3 Hello , I have the free 10GB plan I'm wondering if I'm in excess will I be not...

U

Unsmart•11/10/23, 7:13 PM

You can setup a notification to occur after you reach a certain storage amount but if you go over 10GB you will be charged there's no hard limit and no "free" plan there's only a paid plan that has a free tier.

UUnsmart You can setup a notification to occur after you reach a certain storage amount b...

L

LordWaffl3•11/10/23, 8:35 PM

Doo you know where i can find any doccumentation to create this notification alert ?

LLordWaffl3 Doo you know where i can find any doccumentation to create this notification ale...

C

Chaika•11/10/23, 8:41 PM

https://developers.cloudflare.com/notifications/notification-available/
It's a billing alert, you can create it in the dashboard under Notifications -> Add -> Usage Based Billing -> Product R2 Storage

Available Notifications · Cloudflare Notifications docs

Available Notifications depend on your Cloudflare plan. Cloudflare offers a variety of Notifications for our products and services, such as Billing, …

Z

Z•11/11/23, 4:34 AM

In R2, there is a compressed file whose URL is https://123.r2.cloudflarestorage.com/123.zip. I want to add a signature to this URL. When there is no signature in the URL or the signature does not match, the direct link The resource cannot be accessed. How should this requirement be implemented? I read the official documentation, https://developers.cloudflare.com/r2/api/s3/presigned-urls/, but I still don’t know what to do. I hope I can get your help.

ZZ In R2, there is a compressed file whose URL is https://123.r2.cloudflarestorage....

S

Sid•11/11/23, 4:46 AM

Have you looked at the examples for generating presigned URLs linked on the page?

DigitalOcean Spaces has a limit of 500 req/sec per bucket and 1500 req/sec for all buckets.. so only

Similar Threads

Similar Threads

Similar Threads