Do you have a custom video playback setup? Generally browsers will download the entire video once, a

�

🌈 Mprogramavimai•10/19/23, 4:21 PM

I'm using video just as an example

�

🌈 Mprogramavimai•10/19/23, 4:22 PM

Everything is clear now

�

🌈 Mprogramavimai•10/19/23, 4:23 PM

It's still insanely cheap to host and download even a lot of small files

SSid Do you have a custom video playback setup? Generally browsers will download the ...

A

akash#007•10/19/23, 4:31 PM

I use https://plyr.io/ as video player and hls streaming

Plyr

Plyr - A simple, customizable HTML5 Video, Audio, YouTube and Vimeo...

P

pangea•10/19/23, 5:38 PM

reposting my question: is there support for programatically creating API keys that are scoped to a specific prefix in a bucket? the use case is for allowing an untrusted user to upload a large file to a specific prefix. it seems that to use presigned URLs + multipart uploads, our API would have to create a URL for each part being uploaded which seems a bit messy

Ppangea reposting my question: is there support for programatically creating API keys th...

K

kian•10/19/23, 5:46 PM

Nope

Ddano Is it possible to configure the CDN to return custom object headers (i.e. `x-amz...

K

kian•10/19/23, 5:46 PM

Nope

K

kian•10/19/23, 5:46 PM

Neither features exist at the moment.

D

danny.m•10/19/23, 5:58 PM

looking for how to specify the lenght of a stream I'm creating inside a worker so that I can put it in r2... I have the following example

D

danny.m•10/19/23, 5:58 PM

if (md.val) {
  console.log("MD", md.val)
  await env.CONTENT_BUCKET.put(`${key}-md`, new ReadableStream(md.val))
}

if (md.val) {
  console.log("MD", md.val)
  await env.CONTENT_BUCKET.put(`${key}-md`, new ReadableStream(md.val))
}

if (md.val) {
  console.log("MD", md.val)
  await env.CONTENT_BUCKET.put(`${key}-md`, new ReadableStream(md.val))
}

if (md.val) {
  console.log("MD", md.val)
  await env.CONTENT_BUCKET.put(`${key}-md`, new ReadableStream(md.val))
}

D

danny.m•10/19/23, 5:58 PM

getting this error

D

danny.m•10/19/23, 5:58 PM

Uncaught (in promise) TypeError: Provided readable stream must have a known length (request/response body or readable half of FixedLengthStream)

Uncaught (in promise) TypeError: Provided readable stream must have a known length (request/response body or readable half of FixedLengthStream)

K

kian•10/19/23, 5:59 PM

create a FixedLengthStream

D

danny.m•10/19/23, 5:59 PM

was trying that

K

kian•10/19/23, 5:59 PM

https://developers.cloudflare.com/workers/runtime-apis/streams/transformstream/#fixedlengthstream

D

danny.m•10/19/23, 6:00 PM

not quite sure I'm seeing how to specify the bytes that end up in the readable stream?

D

danny.m•10/19/23, 6:00 PM

oh i think I see... have to write to the writable and then the data becomes readable

Ddanny.m oh i think I see... have to write to the writable and then the data becomes read...

S

SidOP•10/19/23, 6:23 PM

You should also be able to pipe your stream through a FixedLengthStream before sending it to R2

D

danny.m•10/19/23, 7:01 PM

so i was essentially giving that a shot... not sure if I'm doing things incorrectly, but for some reason my write statements seem to not be awaitable... will drop my code here in a sec

D

danny.m•10/19/23, 7:02 PM

while (true) {
  let foo = await reader.read();
  if (foo.value) {
  console.log(foo.value)
  let md = metadataExtractor.extract(foo.value)
  if (md.val) {
    let encoder = new TextEncoder()
    let strung = encoder.encode(JSON.stringify(md.val))
    console.log("MD", strung)
    console.log(strung.length)
    let {readable, writable} = new FixedLengthStream(strung.length)
    let writer = writable.getWriter()
    await writer.write(strung).then(e => console.log({e}))
    await env.CONTENT_BUCKET.put(`${key}-md`, readable)
    console.log("PUT METADATA IN R2")
  }
}

while (true) {
  let foo = await reader.read();
  if (foo.value) {
  console.log(foo.value)
  let md = metadataExtractor.extract(foo.value)
  if (md.val) {
    let encoder = new TextEncoder()
    let strung = encoder.encode(JSON.stringify(md.val))
    console.log("MD", strung)
    console.log(strung.length)
    let {readable, writable} = new FixedLengthStream(strung.length)
    let writer = writable.getWriter()
    await writer.write(strung).then(e => console.log({e}))
    await env.CONTENT_BUCKET.put(`${key}-md`, readable)
    console.log("PUT METADATA IN R2")
  }
}

while (true) {
  let foo = await reader.read();
  if (foo.value) {
  console.log(foo.value)
  let md = metadataExtractor.extract(foo.value)
  if (md.val) {
    let encoder = new TextEncoder()
    let strung = encoder.encode(JSON.stringify(md.val))
    console.log("MD", strung)
    console.log(strung.length)
    let {readable, writable} = new FixedLengthStream(strung.length)
    let writer = writable.getWriter()
    await writer.write(strung).then(e => console.log({e}))
    await env.CONTENT_BUCKET.put(`${key}-md`, readable)
    console.log("PUT METADATA IN R2")
  }
}

while (true) {
  let foo = await reader.read();
  if (foo.value) {
  console.log(foo.value)
  let md = metadataExtractor.extract(foo.value)
  if (md.val) {
    let encoder = new TextEncoder()
    let strung = encoder.encode(JSON.stringify(md.val))
    console.log("MD", strung)
    console.log(strung.length)
    let {readable, writable} = new FixedLengthStream(strung.length)
    let writer = writable.getWriter()
    await writer.write(strung).then(e => console.log({e}))
    await env.CONTENT_BUCKET.put(`${key}-md`, readable)
    console.log("PUT METADATA IN R2")
  }
}

D

danny.m•10/19/23, 7:03 PM

A hanging Promise was canceled. This happens when the worker runtime is waiting for a Promise from JavaScript to resolve, but has detected that the Promise cannot possibly ever resolve because all code and events related to the Promise's I/O context have already finished.
A hanging Promise was canceled. This happens when the worker runtime is waiting for a Promise from JavaScript to resolve, but has detected that the Promise cannot possibly ever resolve because all code and events related to the Promise's I/O context have already finished.

A hanging Promise was canceled. This happens when the worker runtime is waiting for a Promise from JavaScript to resolve, but has detected that the Promise cannot possibly ever resolve because all code and events related to the Promise's I/O context have already finished.
A hanging Promise was canceled. This happens when the worker runtime is waiting for a Promise from JavaScript to resolve, but has detected that the Promise cannot possibly ever resolve because all code and events related to the Promise's I/O context have already finished.

A hanging Promise was canceled. This happens when the worker runtime is waiting for a Promise from JavaScript to resolve, but has detected that the Promise cannot possibly ever resolve because all code and events related to the Promise's I/O context have already finished.
A hanging Promise was canceled. This happens when the worker runtime is waiting for a Promise from JavaScript to resolve, but has detected that the Promise cannot possibly ever resolve because all code and events related to the Promise's I/O context have already finished.

A hanging Promise was canceled. This happens when the worker runtime is waiting for a Promise from JavaScript to resolve, but has detected that the Promise cannot possibly ever resolve because all code and events related to the Promise's I/O context have already finished.
A hanging Promise was canceled. This happens when the worker runtime is waiting for a Promise from JavaScript to resolve, but has detected that the Promise cannot possibly ever resolve because all code and events related to the Promise's I/O context have already finished.

D

danny.m•10/19/23, 7:04 PM

was playing around with promisifying the

write

write

statement and then using

then

then

for the r2 upload... was seeming to work if I never await that promise, but I'd like the upload to occur before sending my response downstream... unsure why it determines that the promise will enver resolve

D

danny.m•10/19/23, 7:10 PM

yeah so weirdly this works...

D

danny.m•10/19/23, 7:11 PM

writer.write(strung).then(() => {
  env.CONTENT_BUCKET.put(`${key}-md`, readable)
}))

writer.write(strung).then(() => {
  env.CONTENT_BUCKET.put(`${key}-md`, readable)
}))

writer.write(strung).then(() => {
  env.CONTENT_BUCKET.put(`${key}-md`, readable)
}))

writer.write(strung).then(() => {
  env.CONTENT_BUCKET.put(`${key}-md`, readable)
}))

D

danny.m•10/19/23, 7:11 PM

and then I'm just never awaiting that promise... kindof odd

D

danny.m•10/19/23, 8:00 PM

no

D

danny.m•10/19/23, 8:00 PM

im parsing information out of it and putting that in r2

D

danny.m•10/19/23, 8:02 PM

im not on a free plan

D

danny.m•10/19/23, 8:02 PM

it's odd, making it thenable and trying to log errors, not getting any info about why my promises will never resolve

D

danny.m•10/19/23, 8:03 PM

im using FixedLengthStream

D

danny.m•10/19/23, 8:05 PM

it never responds when i don't use an await

D

danny.m•10/19/23, 8:07 PM

which makes sense to me... .write returns a promise

D

danny.m•10/19/23, 8:09 PM

it does write to r2

D

danny.m•10/19/23, 8:09 PM

but it doensn't respond

D

danny.m•10/19/23, 8:11 PM

i just didn't include this

D

danny.m•10/19/23, 8:11 PM

if (foo.done) {
                        break
                    }
                }
                metadataExtractor.clear()
                await bucketUpload;
                await env.CONTENT_BUCKET.put(`${key}-md`, readable)
        return new Response(`Put ${key} successfully! with count of ${count}`);

if (foo.done) {
                        break
                    }
                }
                metadataExtractor.clear()
                await bucketUpload;
                await env.CONTENT_BUCKET.put(`${key}-md`, readable)
        return new Response(`Put ${key} successfully! with count of ${count}`);

if (foo.done) {
                        break
                    }
                }
                metadataExtractor.clear()
                await bucketUpload;
                await env.CONTENT_BUCKET.put(`${key}-md`, readable)
        return new Response(`Put ${key} successfully! with count of ${count}`);

if (foo.done) {
                        break
                    }
                }
                metadataExtractor.clear()
                await bucketUpload;
                await env.CONTENT_BUCKET.put(`${key}-md`, readable)
        return new Response(`Put ${key} successfully! with count of ${count}`);

D

danny.m•10/19/23, 8:11 PM

it breaks out

D

danny.m•10/19/23, 8:15 PM

seems i needed to close my writer after

D

danny.m•10/19/23, 8:15 PM

writer.close()

C

Chris•10/20/23, 12:49 AM

Any R2 product managers/engineers in this channel? What's the official process for filing a bug with R2?

K

kian•10/20/23, 12:50 AM

Posting it here means an engineer might see it, but the best route is through a support ticket.

C

cloneth•10/20/23, 3:03 PM

Hey, I'm having problems with R2

Ccloneth Hey, I'm having problems with R2

C

Chaika•10/20/23, 3:08 PM

Can you be a bit more specific?

GGuyzeroth Hello, I am using the R2 multipart upload as per https://developers.cloudflare.c...

C

Chaika•10/20/23, 3:09 PM

wrangler 3.x dev uses local mode by default, which uses a local/simulated r2 bucket for testing. If you want to use your remote/real resources, you can use

wrangler dev --remote

wrangler dev --remote

C

Chaika•10/20/23, 3:12 PM

As far as I know, no. The simulation is just of a the bucket via the worker api, not of the entire s3 api. You could use

preview_bucket_name

preview_bucket_name

which is what --remote would use, and have a seperate remote testing bucket that doesn't mess with your production data
https://developers.cloudflare.com/workers/wrangler/configuration/#r2-buckets

CChaika Can you be a bit more specific?

C

cloneth•10/20/23, 3:14 PM

We are trying to distribute movies with R2 for a movie site. We continued like this for a long time, there were no problems. However, our video player has not been working properly for 2 days due to problems caused by R2.

Ccloneth We are trying to distribute movies with R2 for a movie site. We continued like t...

C

Chaika•10/20/23, 3:18 PM

Do you get a specific error from R2 or any more details on how it's not working and you think it's R2?

Do you have a custom video playback setup? Generally browsers will download the entire video once, a

Similar Threads

Similar Threads

Similar Threads