Does R2 support https://docs.aws.amazon.com/AmazonS3/latest/API/API_UploadPartCopy.html ?

Cceelo21 Does R2 support https://docs.aws.amazon.com/AmazonS3/latest/API/API_UploadPartCo...

K

kev-ac•8/18/23, 4:00 PM

Here you'll find all supported S3 operations: https://developers.cloudflare.com/r2/api/s3/api/
(And yes, UploadPartCopy is one of them)

S3 API compatibility · Cloudflare R2 docs

R2 implements the S3 API to allow users and their applications to migrate with ease. When comparing to AWS S3, Cloudflare has removed some API …

C

ceelo21OP•8/18/23, 4:11 PM

@kev_ac Thank you for the quick reply! It says it is supported, however it looks like the header

x-amz-copy-source

x-amz-copy-source

x-amz-copy-source

x-amz-copy-source is not supported on your docs, but that is required for this operation to work right?

Cceelo21 @kev_ac Thank you for the quick reply! It says it is supported, however it looks...

K

kev-ac•8/18/23, 4:11 PM

I'm not a CF employee and never used UploadPartCopy in any project. So sadly I cannot answer you this

C

ceelo21OP•8/18/23, 4:12 PM

Ok thanks again, hopefully someone can answer

C

ceelo21OP•8/18/23, 4:12 PM

I will also just try to implement and see how that goes

K

kev-ac•8/18/23, 4:13 PM

But if UploadPartCopy is generally a supported operation, there has to be a functional way without the unsupported headers

C

ceelo21OP•8/18/23, 4:15 PM

Agreed, maybe the header is supported and documentation is wrong

J

Julian•8/18/23, 7:17 PM

Hey, has anybody here seen elevated

522

522 errors on R2 today? I'm not seeing anything on the status page, but we're seeing dozens of errors when trying to

HEAD

HEAD

HEAD

HEAD objects.

SSky Zhou It seems not the correct way to pass key and secret? I saw this endpoint url a a...

J

John Kirkpatrick•8/18/23, 7:19 PM

Do you have links? I didn't understand your attached image. -thanks

JJohn Kirkpatrick Do you have links? I didn't understand your attached image. -thanks

S

Sky Zhou•8/18/23, 7:30 PM

Yeah sure. NP.
https://developers.cloudflare.com/r2/api/s3/api/
https://docs.aws.amazon.com/AmazonS3/latest/API/sigv4-auth-using-authorization-header.html
I think the postman examples are easier to understand. https://www.postman.com/cloudflare-r2/workspace/cloudflare-r2/collection/20913290-14ddd8d8-3212-490d-8647-88c9dc557659?action=share&creator=20913290&tab=authorization

J

John Kirkpatrick•8/18/23, 7:31 PM

I'll check this out, thank you very much!

R

rob•8/20/23, 4:32 PM

is there a way to download files from r2 with the API? like by not using workers/bindings

R

rob•8/20/23, 4:33 PM

if i wanted to have an off-cloudflare service have access to the R2

R

rob•8/20/23, 4:33 PM

as like a mounted drive or something

Rrob is there a way to download files from r2 with the API? like by not using workers...

H

Hello, I’m Allie!•8/20/23, 4:41 PM

https://developers.cloudflare.com/r2/api/s3/api/

S3 API compatibility · Cloudflare R2 docs

R2 implements the S3 API to allow users and their applications to migrate with ease. When comparing to AWS S3, Cloudflare has removed some API …

U

ultrakiller•8/20/23, 5:27 PM

Hey! I am trying to upload files to r2 and getting this error-

This service may not be available in the `us-east-1' region. Any solutions?

ps- tried setting it to auto.

C

chumbalaya•8/21/23, 1:38 AM

Hello, we're pulling images for our site using R2 + Workers. Was curious if we could layer on any more Cloudlfare products to lossless-ly optimize those images

I've tried turning on Polish from within "Speed > Image Optimization", but the size of the images seems to be the same when I fetch to onto the site as they are in R2. Any ideas?

Y

yinxingmaiming6409•8/21/23, 7:46 AM

I use C # and Minio's PutObject Async method, but I will wait indefinitely and cannot upload. Why?

L

lachie•8/21/23, 1:20 PM

Would it be possible to pipe an object from CloudFlare R2 directly into a URL (e.g. pipe a video into YouTube RMTP) with the same zero-egress?

ي

يزن•8/21/23, 3:28 PM

$ pnpm wrangler r2 object get preview-hadwa/x.webp
 ⛅️ wrangler 3.0.0 (update available 3.5.1)
-----------------------------------------------------
Downloading "x.webp" from "preview-hadwa".
Download complete.

$ pnpm wrangler r2 object get preview-hadwa/x.webp
 ⛅️ wrangler 3.0.0 (update available 3.5.1)
-----------------------------------------------------
Downloading "x.webp" from "preview-hadwa".
Download complete.

$ pnpm wrangler r2 object get preview-hadwa/x.webp
 ⛅️ wrangler 3.0.0 (update available 3.5.1)
-----------------------------------------------------
Downloading "x.webp" from "preview-hadwa".
Download complete.

$ pnpm wrangler r2 object get preview-hadwa/x.webp
 ⛅️ wrangler 3.0.0 (update available 3.5.1)
-----------------------------------------------------
Downloading "x.webp" from "preview-hadwa".
Download complete.

when I run this code with

wrangler dev

wrangler dev

wrangler dev

wrangler dev I get null

export default {
    async fetch(request: Request, env: Env, ctx: ExecutionContext): Promise<Response> {
        console.log(await env.HADWA_BUCKET.get("x.webp"))
        return new Response('Hello World!');
    },
};

export default {
    async fetch(request: Request, env: Env, ctx: ExecutionContext): Promise<Response> {
        console.log(await env.HADWA_BUCKET.get("x.webp"))
        return new Response('Hello World!');
    },
};

export default {
    async fetch(request: Request, env: Env, ctx: ExecutionContext): Promise<Response> {
        console.log(await env.HADWA_BUCKET.get("x.webp"))
        return new Response('Hello World!');
    },
};

export default {
    async fetch(request: Request, env: Env, ctx: ExecutionContext): Promise<Response> {
        console.log(await env.HADWA_BUCKET.get("x.webp"))
        return new Response('Hello World!');
    },
};

and when I run

HADWA_BUCKET.list()

HADWA_BUCKET.list()

HADWA_BUCKET.list()

HADWA_BUCKET.list() I get this

Object {
  objects: Array(0),
  truncated: false,
  delimitedPrefixes: Array(0)
}

Object {
  objects: Array(0),
  truncated: false,
  delimitedPrefixes: Array(0)
}

Object {
  objects: Array(0),
  truncated: false,
  delimitedPrefixes: Array(0)
}

Object {
  objects: Array(0),
  truncated: false,
  delimitedPrefixes: Array(0)
}

wrangler.toml

name = "my-worker"
compatibility_date = "2023-08-14"

account_id = "<my account id>"
workers_dev = true

[[r2_buckets]]
binding = 'HADWA_BUCKET'
bucket_name = 'hadwa'
preview_bucket_name = 'preview-hadwa'

name = "my-worker"
compatibility_date = "2023-08-14"

account_id = "<my account id>"
workers_dev = true

[[r2_buckets]]
binding = 'HADWA_BUCKET'
bucket_name = 'hadwa'
preview_bucket_name = 'preview-hadwa'

name = "my-worker"
compatibility_date = "2023-08-14"

account_id = "<my account id>"
workers_dev = true

[[r2_buckets]]
binding = 'HADWA_BUCKET'
bucket_name = 'hadwa'
preview_bucket_name = 'preview-hadwa'

name = "my-worker"
compatibility_date = "2023-08-14"

account_id = "<my account id>"
workers_dev = true

[[r2_buckets]]
binding = 'HADWA_BUCKET'
bucket_name = 'hadwa'
preview_bucket_name = 'preview-hadwa'

any help would be appreciated

Original message was deleted

C

chientrm.com•8/21/23, 3:36 PM

it never was

Original message was deleted

C

Chaika•8/21/23, 3:53 PM

I think you're right about the fact that other subdomains exist, and they have CAA records, causing a CAA issue. I responded on the community post with more info.

C

Chaika•8/21/23, 3:56 PM

I was able to repro the same issue by setting Let's Encrypt CAA only on the lower subdomain, and then it wasn't able to issue it, and then setting the caa for digicert on the same level and readding it allowed it to issue it. Which makes sense, it's how CAA records work. So just create the necessary CAA records on the hostname you're trying to add and readd it, and you should be golden

Original message was deleted

C

Chaika•8/21/23, 4:02 PM

you don't need to, I clarified my message

Original message was deleted

C

Chaika•8/21/23, 4:02 PM

yep

C

Chaika•8/21/23, 4:06 PM

it went active for me and takes a sec to issue it after, I wonder if you've hit a rate limit or something due to failures though, hmmm

C

Chaika•8/21/23, 4:12 PM

your caa records are the same as mine in my mock setup with le on a subdomain below and all above, and I could repro the same issue, so I don't think there could be anything else blocking it. You don't appear to have any redirect/other issue that would be breaking validation, hmmm

C

Chaika•8/21/23, 4:18 PM

yea those look fine, do you have ACM?

C

Chaika•8/21/23, 4:19 PM

nahh it was just my idea of a slap fix, issue a cert via ACM from a diff provider

C

Chaika•8/21/23, 4:19 PM

your caa records are already set fine (now) as far as I can see

C

Chaika•8/21/23, 4:20 PM

if something tried to issue now for that hostname from one of those, it should be allowed

C

Chaika•8/21/23, 4:21 PM

no, it should have still failed

C

Chaika•8/21/23, 4:21 PM

I don't know if it would have given you an error, if you were using ACM, you should at least have got something useful if you had Adv. Cert. Alerts on, which notifies you about issuance errors. Usually those contain exact details on errors

C

Chaika•8/21/23, 4:23 PM

If she has a free moment, perhaps she could check on it internally as well, might be something more useful now

E

Erisa•8/21/23, 4:24 PM

Whats up

E

Erisa•8/21/23, 4:24 PM

theres not a lot I can do in terms of debugging right now but do you need me to quickly check smth?

C

Chaika•8/21/23, 4:25 PM

he tried adding "surveys.helpdesk.support.rydercragie.com" a month ago as an R2 Custom Domain, it never could issue the cert. It looks like it might have been because he had CAA records on a subdomain below it (helpdesk.support.rydercragie.com), that were preventing it from issuing it. CAA issues resolved, but it's still not issued yet (granted, it's only been 10-20 minutes after readding it). Not sure if something else is wrong as well, or a rate limit now for the domain, or something else

Original message was deleted

ي

يزن•8/21/23, 4:51 PM

thank you

Original message was deleted

ي

يزن•8/21/23, 4:57 PM

is there a way to do the same with wrangler pages? I can't seem to find one

ي

يزن•8/21/23, 4:58 PM

https://github.com/cloudflare/workers-sdk/issues/3505 :NotLikeThis:

GitHub

🚀 Feature Request: `wrangler pages dev --remote` · Issue #3505 · cl...

Describe the solution Hi everyone, When developing frontend applications using Cloudflare pages, we use some of the CF- headers to validate some requests (for example, getting the cf-ipcountry to s...

ي

يزن•8/21/23, 5:13 PM

what do you do to work around this? any workarounds?

U

Unsmart•8/21/23, 6:59 PM

Depends what you mean by issue... its expected if you are reading the same object too many times concurrently

U

Unsmart•8/21/23, 7:03 PM

Not sure if theres a set number

it just happens when you are requesting too many times for the same file