following the docs for using r2 from workers... For some reason env.MY_BUCKET isn't working even th

Ddanny.m following the docs for using r2 from workers... For some reason env.MY_BUCKET i...

H

Can you paste your

wrangler.toml

wrangler.toml

?

D

danny.mOP•10/16/23, 6:43 PM

name = "dark-voice-8281"
main = "src/index.js"
compatibility_date = "2023-10-10"
account_id = "my-account-id"
workers_dev = true

# Variable bindings. These are arbitrary, plaintext strings (similar to environment variables)
# Note: Use secrets to store sensitive data.
# Docs: https://developers.cloudflare.com/workers/platform/environment-variables
# [vars]
# MY_VARIABLE = "production_value"

# Bind a KV Namespace. Use KV as persistent storage for small key-value pairs.
# Docs: https://developers.cloudflare.com/workers/runtime-apis/kv
# [[kv_namespaces]]
# binding = "MY_KV_NAMESPACE"
# id = "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx"

# Bind an R2 Bucket. Use R2 to store arbitrarily large blobs of data, such as files.
# Docs: https://developers.cloudflare.com/r2/api/workers/workers-api-usage/
# [[r2_buckets]]
# binding = "EXTRACTOR_BINDING"
# bucket_name = "extractor"

name = "dark-voice-8281"
main = "src/index.js"
compatibility_date = "2023-10-10"
account_id = "my-account-id"
workers_dev = true

# Variable bindings. These are arbitrary, plaintext strings (similar to environment variables)
# Note: Use secrets to store sensitive data.
# Docs: https://developers.cloudflare.com/workers/platform/environment-variables
# [vars]
# MY_VARIABLE = "production_value"

# Bind a KV Namespace. Use KV as persistent storage for small key-value pairs.
# Docs: https://developers.cloudflare.com/workers/runtime-apis/kv
# [[kv_namespaces]]
# binding = "MY_KV_NAMESPACE"
# id = "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx"

# Bind an R2 Bucket. Use R2 to store arbitrarily large blobs of data, such as files.
# Docs: https://developers.cloudflare.com/r2/api/workers/workers-api-usage/
# [[r2_buckets]]
# binding = "EXTRACTOR_BINDING"
# bucket_name = "extractor"

name = "dark-voice-8281"
main = "src/index.js"
compatibility_date = "2023-10-10"
account_id = "my-account-id"
workers_dev = true

# Variable bindings. These are arbitrary, plaintext strings (similar to environment variables)
# Note: Use secrets to store sensitive data.
# Docs: https://developers.cloudflare.com/workers/platform/environment-variables
# [vars]
# MY_VARIABLE = "production_value"

# Bind a KV Namespace. Use KV as persistent storage for small key-value pairs.
# Docs: https://developers.cloudflare.com/workers/runtime-apis/kv
# [[kv_namespaces]]
# binding = "MY_KV_NAMESPACE"
# id = "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx"

# Bind an R2 Bucket. Use R2 to store arbitrarily large blobs of data, such as files.
# Docs: https://developers.cloudflare.com/r2/api/workers/workers-api-usage/
# [[r2_buckets]]
# binding = "EXTRACTOR_BINDING"
# bucket_name = "extractor"

name = "dark-voice-8281"
main = "src/index.js"
compatibility_date = "2023-10-10"
account_id = "my-account-id"
workers_dev = true

# Variable bindings. These are arbitrary, plaintext strings (similar to environment variables)
# Note: Use secrets to store sensitive data.
# Docs: https://developers.cloudflare.com/workers/platform/environment-variables
# [vars]
# MY_VARIABLE = "production_value"

# Bind a KV Namespace. Use KV as persistent storage for small key-value pairs.
# Docs: https://developers.cloudflare.com/workers/runtime-apis/kv
# [[kv_namespaces]]
# binding = "MY_KV_NAMESPACE"
# id = "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx"

# Bind an R2 Bucket. Use R2 to store arbitrarily large blobs of data, such as files.
# Docs: https://developers.cloudflare.com/r2/api/workers/workers-api-usage/
# [[r2_buckets]]
# binding = "EXTRACTOR_BINDING"
# bucket_name = "extractor"

D

danny.mOP•10/16/23, 6:45 PM

in my worker I'm getting

env.MY_BUCKET

env.MY_BUCKET

env.MY_BUCKET

env.MY_BUCKET not defined

D

danny.mOP•10/16/23, 6:47 PM

 "exceptions": [
    {
      "name": "TypeError",
      "message": "Cannot read properties of undefined (reading 'get')",
      "timestamp": 1697482002476
    }
  ],

 "exceptions": [
    {
      "name": "TypeError",
      "message": "Cannot read properties of undefined (reading 'get')",
      "timestamp": 1697482002476
    }
  ],

 "exceptions": [
    {
      "name": "TypeError",
      "message": "Cannot read properties of undefined (reading 'get')",
      "timestamp": 1697482002476
    }
  ],

 "exceptions": [
    {
      "name": "TypeError",
      "message": "Cannot read properties of undefined (reading 'get')",
      "timestamp": 1697482002476
    }
  ],

D

danny.mOP•10/16/23, 6:47 PM

const object = await env.MY_BUCKET.get(key);

const object = await env.MY_BUCKET.get(key);

const object = await env.MY_BUCKET.get(key);

const object = await env.MY_BUCKET.get(key);

D

danny.mOP•10/16/23, 6:48 PM

D

danny.mOP•10/16/23, 6:49 PM

so the bucket_name is correct

C

Chaika•10/16/23, 6:49 PM

Your r2 binding is commented out. Also, the way you access it depends on if you're using Service Worker or Module Worker format

C

Chaika•10/16/23, 6:50 PM

If you don't know which format you're using, if you are using

addEventListener

addEventListener

addEventListener

addEventListener, it's service worker and bindings are globals. If you have

export default {
  fetch(request, env, ctx) {

export default {
  fetch(request, env, ctx) {

export default {
  fetch(request, env, ctx) {

export default {
  fetch(request, env, ctx) {

It's a module format and it's on env

D

danny.mOP•10/16/23, 6:53 PM

I'm not using an event listener, but i only have

request

request

and

env

env

... not

ctx

ctx

D

danny.mOP•10/16/23, 6:53 PM

using these docs https://developers.cloudflare.com/r2/api/workers/workers-api-usage/

Use R2 from Workers · Cloudflare R2 docs

C3 (create-cloudflare-cli) is a command-line tool designed to help you set up and deploy Workers & Pages applications to Cloudflare as fast as …

D

danny.mOP•10/16/23, 6:54 PM

i uncommented the relevant fields in teh toml

D

danny.mOP•10/16/23, 6:55 PM

i guess the docs say that it's a module worker

Ddanny.m i uncommented the relevant fields in teh toml

C

Chaika•10/16/23, 6:59 PM

yea that's fine, it's a module worker.
When you run dev, it prints out the bindings your worker uses, do you see r2's?
You may need to add

preview_bucket_name

preview_bucket_name

field as well, and create a separate testing bucket or assign it to the same to ignore it, it'll tell you on startup though if you're on a version that requires it

D

danny.mOP•10/16/23, 7:15 PM

got it working thank you!

I

Icestonks•10/16/23, 7:45 PM

Is it possible to stream videos with R2?

IIcestonks Is it possible to stream videos with R2?

Z

Zora•10/16/23, 8:08 PM

Yes

Z

Zora•10/16/23, 8:08 PM

It's exempt from the CDN ToS

IIcestonks Is it possible to stream videos with R2?

E

Erisa•10/16/23, 8:14 PM

Yes, you can stream whatever you like from R2 without any issues, you'll pay for the storage and requests from R2

D

danny.mOP•10/16/23, 9:12 PM

currently playing around w/ reading data being streamed as it's uploaded to r2. seems the process of reading disturbs the readable stream though? Maybe I need to pipe it into another stream or something?

D

danny.mOP•10/16/23, 9:12 PM

let reader = request.body.getReader()
                console.log({reader})
                let pending = true;
                while (pending) {
                    let foo = await reader.read();
                    console.log(foo)
                    if (foo.done) {
                        pending = false
                    }
                }
                reader.releaseLock()
                await env.EXTRACTOR_BINDING.put(key, request.body);
        return new Response(`Put ${key} successfully! with count of ${count}`);

let reader = request.body.getReader()
                console.log({reader})
                let pending = true;
                while (pending) {
                    let foo = await reader.read();
                    console.log(foo)
                    if (foo.done) {
                        pending = false
                    }
                }
                reader.releaseLock()
                await env.EXTRACTOR_BINDING.put(key, request.body);
        return new Response(`Put ${key} successfully! with count of ${count}`);

let reader = request.body.getReader()
                console.log({reader})
                let pending = true;
                while (pending) {
                    let foo = await reader.read();
                    console.log(foo)
                    if (foo.done) {
                        pending = false
                    }
                }
                reader.releaseLock()
                await env.EXTRACTOR_BINDING.put(key, request.body);
        return new Response(`Put ${key} successfully! with count of ${count}`);

let reader = request.body.getReader()
                console.log({reader})
                let pending = true;
                while (pending) {
                    let foo = await reader.read();
                    console.log(foo)
                    if (foo.done) {
                        pending = false
                    }
                }
                reader.releaseLock()
                await env.EXTRACTOR_BINDING.put(key, request.body);
        return new Response(`Put ${key} successfully! with count of ${count}`);

D

danny.mOP•10/16/23, 9:13 PM

able to log anything, but calling

put

put

causes this error

D

danny.mOP•10/16/23, 9:13 PM

Uncaught (in response) TypeError: This ReadableStream is disturbed.

Uncaught (in response) TypeError: This ReadableStream is disturbed.

Uncaught (in response) TypeError: This ReadableStream is disturbed.

Uncaught (in response) TypeError: This ReadableStream is disturbed.

K

kian•10/16/23, 9:39 PM

I’m not sure I understand what you’re trying to do

K

kian•10/16/23, 9:39 PM

You’ve consumed the stream, you can’t pass it to put as there’s nothing left

D

danny.mOP•10/16/23, 9:40 PM

i guess i want to consume it twice... or find a way to grab data out of the chunks that I'll persist while passing them into put

K

kian•10/16/23, 9:41 PM

tee() will split a ReadableStream into two ReadableStreams

K

kian•10/16/23, 9:42 PM

https://developer.mozilla.org/en-US/docs/Web/API/ReadableStream/tee

D

danny.mOP•10/16/23, 9:42 PM

that looks like exactly what I want... thank you

EErisa Yes, you can stream whatever you like from R2 without any issues, you'll pay for...

I

Icestonks•10/16/23, 9:59 PM

How would you go about doing that? I only know how to get a full object. The full mp4 file

K

kian•10/16/23, 10:00 PM

Browsers would do range requests to load the video in chunks

I

Icestonks•10/16/23, 10:00 PM

automatically?

E

Erisa•10/16/23, 10:15 PM

Yes

E

Erisa•10/16/23, 10:16 PM

Point a browser at a video URL in a supported format for that browser and will automatically make use of range requests to stream the video and faciliate seeks

E

Erisa•10/16/23, 10:16 PM

Provided what youre pointing at supports range requests, which R2 does by default for custom domains

M

mavxyz•10/16/23, 10:39 PM

Hi, so does anyone know of a good tool to make a publicly facing list of all the contents in an r2 bucket? Kind of something like the Apache DirectoryIndex feature... (that is also compatible with workers, or pages)

K

kian•10/16/23, 10:49 PM

https://github.com/kotx/render

GitHub

GitHub - kotx/render: Cloudflare Worker to proxy and cache requests...

Cloudflare Worker to proxy and cache requests to R2 - GitHub - kotx/render: Cloudflare Worker to proxy and cache requests to R2

M

mavxyz•10/16/23, 10:49 PM

merci

E

Erisa•10/16/23, 11:31 PM

Not currently possible to log events like that

EErisa Not currently possible to log events like that

P

polymo1•10/16/23, 11:57 PM

Will it be possible in the future?

EErisa Not currently possible to log events like that

R

Raiyan•10/17/23, 12:17 AM

is there any plan for r2 upload triggers with worker?

R

Raiyan•10/17/23, 12:18 AM

?r2-roadmap

F

Flare•10/17/23, 12:18 AM

These features are now available!!

Object Lifecycles: https://developers.cloudflare.com/r2/buckets/object-lifecycles/
Public buckets, with custom domains: https://developers.cloudflare.com/r2/data-access/public-buckets/#enable-public-access-for-your-bucket
Presigned URLs in the S3-compatible API
Location Hints (e.g. 'EU')
Object Migration (S3->R2)

M

mavxyz•10/17/23, 1:06 AM

NoSuchKey: The specified key does not exist.
NoSuchKey: The specified key does not exist.
NoSuchKey: The specified key does not exist.
NoSuchKey: The specified key does not exist. does this mean that I provided the wrong access key?