Cloudflare Developers•4y ago

Which tile map source do you use? Some forbid caching.

JJacob Nice! I've found it's a challenge to efficiently host Leaflet maps at scale. I h...

MyZeD•7/7/22, 5:55 PM

this is another thing ;)

Ffunmiles.Which tile map source do you use? Some forbid caching.

MyZeD•7/7/22, 5:55 PM

If i pay them, so it can't be forbidden.
but i check that, thanks

Ffunmiles.Which tile map source do you use? Some forbid caching.

MyZeD•7/7/22, 5:56 PM

Amazon Location Service

funmiles.OP•7/7/22, 5:59 PM

@MyZeD I have an app where I wanted to use maps with vector tiles. I also wanted to tune the styling. I initially used mapbox, then maplibre but reading the licenses, it seems they don't want you to cache . Right now, I'm just using a 3D view of the world I made with free NASA images.

funmiles.OP•7/7/22, 6:03 PM

I actually want tiles up to level 9 or 10. I'm willing to pay for building all the tiles from openstreetmap data once and keep using them.

MMyZeD If i pay them, so it can't be forbidden. but i check that, thanks

funmiles.OP•7/7/22, 6:06 PM

I think their logic is you pay per a certain amount of tiles you retrieve. If you have a lot of user, they want you to pay essentially something for each user. I've read some of the agreement and some specifically say you can only serve the tiles from one retrieval to one user...

funmiles.OP•7/7/22, 6:12 PM

https://aws.amazon.com/service-terms/ Section 82.3 specifically says you cannot cache most of the data.

Amazon Web Services, Inc.

AWS Service Terms

Ffunmiles.All the examples in Cloudflare's R2 documentation for javascript use aws-sdk V2....

beelzabub•7/7/22, 6:17 PM

Not yet. Internally we use v2 for all our tests so that's why we have v2 examples everywhere. We're happy to take contributions to add v3 examples.

Bbeelzabub Not yet. Internally we use v2 for all our tests so that's why we have v2 example...

funmiles.OP•7/7/22, 6:19 PM

I could not find an example to store or retrieve data. Can you point me to an example?

funmiles.OP•7/7/22, 6:20 PM

Or can I use my code from AWS and do the same, except for the region argument?

funmiles.OP•7/7/22, 6:20 PM

my AWS v3 code.

kian•7/7/22, 6:22 PM

You’ll need to specify the R2 endpoint as your bucketEndpoint in the S3 client constructor’s config

kian•7/7/22, 6:22 PM

That’s all most the examples are doing - the code beyond that is the same as you’d use for S3, B2, GCS, etc for the most part

kian•7/7/22, 6:23 PM

I never made a V3 example since there was already the V2 one personally

kian•7/7/22, 6:25 PM

tbh there was one SDK that rejected my R2 token since it’s a different length to the AWS tokens but I wouldn’t be able to tell you which it was since I never looked into how to get around it and just used another SDK

funmiles.OP•7/7/22, 6:33 PM

OK I'll just try. BTW is it normal that with the V2 SDK, a listBuckets() takes about 2 seconds?

kian•7/7/22, 6:36 PM

import {S3Client} from "@aws-sdk/client-s3"
import {GetObjectCommand} from "@aws-sdk/client-s3"

const ACCOUNT_ID = 'x'
const ACCESS_KEY_ID = 'x'
const SECRET_ACCESS_KEY = 'x'

const S3 = new S3Client({
    region: "auto",
    endpoint: `https://${ACCOUNT_ID}.r2.cloudflarestorage.com`,
    credentials: {
        accessKeyId: ACCESS_KEY_ID,
        secretAccessKey: SECRET_ACCESS_KEY,
    }
});

console.log(
    await S3.send(new GetObjectCommand({
        Bucket: "sdk-example",
        Key: "ferriswasm.png"
    }))
)

import {S3Client} from "@aws-sdk/client-s3"
import {GetObjectCommand} from "@aws-sdk/client-s3"

const ACCOUNT_ID = 'x'
const ACCESS_KEY_ID = 'x'
const SECRET_ACCESS_KEY = 'x'

const S3 = new S3Client({
    region: "auto",
    endpoint: `https://${ACCOUNT_ID}.r2.cloudflarestorage.com`,
    credentials: {
        accessKeyId: ACCESS_KEY_ID,
        secretAccessKey: SECRET_ACCESS_KEY,
    }
});

console.log(
    await S3.send(new GetObjectCommand({
        Bucket: "sdk-example",
        Key: "ferriswasm.png"
    }))
)

kian•7/7/22, 6:37 PM

kian•7/7/22, 6:37 PM

That's an example

Ffunmiles.https://aws.amazon.com/service-terms/ Section 82.3 specifically says you cannot ...

MyZeD•7/7/22, 6:39 PM

Thank you for this information

Kkian ```js import {S3Client} from "@aws-sdk/client-s3" import {GetObjectCommand} from...

funmiles.OP•7/7/22, 6:43 PM

That looks like V3 to me. The import for V2 is

import S3 from 'aws-sdk/clients/s3.js';

import S3 from 'aws-sdk/clients/s3.js';

from my understanding.

funmiles.OP•7/7/22, 6:44 PM

So your example is quite useful

kian•7/7/22, 6:44 PM

Yeah, it's a V3 example

kian•7/7/22, 6:44 PM

There's already V2 examples in the docs

Ffunmiles.All the examples in Cloudflare's R2 documentation for javascript use aws-sdk V2....

kian•7/7/22, 6:44 PM

It was in reply to this

funmiles.OP•7/7/22, 6:46 PM

Ah thanks a bunch!

funmiles.OP•7/7/22, 6:58 PM

I was able to store my first file.

Kkian Yeah, it's a V3 example

beelzabub•7/7/22, 7:05 PM

Mind throwing that up in the docs so that we have both? Can be part of the JS page

kian•7/7/22, 7:06 PM

Sounds good to me

kian•7/7/22, 7:06 PM

Will PR it in a bit

funmiles.OP•7/7/22, 7:08 PM

For me what I was missing compared to AWS are the

region: 'auto'

region: 'auto'

and even more the `endpoint:

https://${ACCOUNT_ID}.r2.cloudflarestorage.com\

https://${ACCOUNT_ID}.r2.cloudflarestorage.com\

parts

kian•7/7/22, 7:11 PM

It works without the region to be fair - R2 accepts an empty string and

us-east-1

us-east-1

as aliases to

auto

auto

but for completeness, it's best to use

auto

auto

funmiles.OP•7/7/22, 7:25 PM

Thanks for the clarification. Still end

endpoint

endpoint

is necessary, right? Without it I had an error telling me the account was wrong, or something of the sort.

kian•7/7/22, 7:25 PM

Yeah

!!NWDD Also, where can i report a bug or check if a bug has been reported?

kian•7/7/22, 7:42 PM

Probably just searching for it here and if it isn't mentioned, post it here haha

kian•7/7/22, 8:36 PM

would/should I use the S3 API for that?

Yeah

kian•7/7/22, 8:38 PM

There's a SDK for pretty much every language or tooling like rclone/aws CLI/etc so it should be pretty easy

Jacob•7/7/22, 8:46 PM

rclone is the best!

Original message was deleted

beelzabub•7/7/22, 10:42 PM

Same limits as S3

!!NWDD is `x-amz-checksum-sha256` not implemented yet for PutObjects? (asking because i...

beelzabub•7/7/22, 10:43 PM

No. Amazon added those headers towards the end of our entry into open beta

beelzabub•7/7/22, 10:43 PM

Just haven't gone & updated the docs

Flare•7/7/22, 11:00 PM

The following features are currently on the roadmap for R2 but not yet implemented.

Public Buckets
Mapping a bucket to your custom domain
Pre-signed URLs are now implemented!

In the meantime, you can use a Worker to replicate the vast majority of functionality such as serving & caching public assets.
Take a look at the Demo Worker example here: https://developers.cloudflare.com/r2/examples/demo-worker/
Also, there's a great community project called Render that's made for R2:
https://github.com/kotx/render

Workers will not be required for making assets publicly available in the future, they are just an interim stop-gap.

James•7/7/22, 11:03 PM

This is very cool

https://up.jross.me/52b0dz9l

JJames This is very cool 👀 https://up.jross.me/52b0dz9l

beelzabub•7/8/22, 12:02 AM

Bbeelzabub ?

James•7/8/22, 12:03 AM

dashboard now shows information about an object, and any metadata

James•7/8/22, 12:04 AM

looks like that landed in a dashboard release earlier today

import {S3Client} from "@aws-sdk/client-s3" import {GetObjectCommand} from "@aws-sdk/client-s3" const ACCOUNT_ID = 'x' const ACCESS_KEY_ID = 'x' const SECRET_ACCESS_KEY = 'x' const S3 = new S3Client({ region: "auto", endpoint: `https://${ACCOUNT_ID}.r2.cloudflarestorage.com`, credentials: { accessKeyId: ACCESS_KEY_ID, secretAccessKey: SECRET_ACCESS_KEY, } }); console.log( await S3.send(new GetObjectCommand({ Bucket: "sdk-example", Key: "ferriswasm.png" })) )