If it helps I have an auto updating api mapping IATA Code -> nearby region here: https://colo.cloudf

If it helps I have an auto updating api mapping IATA Code -> nearby region here: https://colo.cloudflare.chaika.me/?iataregion
Example of using that list to update a worker every 12 hours and route to closest bucket:
https://github.com/Tyler-OBrien/cf-multi-bucket-routing
https://r2-closest-region.workers.chaika.me/index.html
No easy build in api though sadly

RAGman•3/28/24, 6:23 PM

does R2 have support for s3 triggers (ie. to trigger a lambda in aws) like AWS S3 does? Example, on upload completion I want to trigger lambda

RAGman•3/28/24, 6:27 PM

Thanks

RAGman•3/28/24, 6:31 PM

are there any event driven triggers for R2? Like a Worker that triggers off an upload?

CChaika If it helps I have an auto updating api mapping IATA Code -> nearby region here:...

dave•3/28/24, 6:33 PM

oh nice, that's perfect!

RAGman•3/28/24, 6:36 PM

so, R2 is still quite limited then...yes?

rootalien•3/28/24, 6:39 PM

When I use r2, can I get the URL of every file uploaded to my site?
for example example.com/video474.mp4

example.r2.dev/video474.mp4
like example.r2.dev/video8461.mp4

rootalien•3/28/24, 6:41 PM

I tried using workers for cdn, but when there are many visitors, the loading time becomes very slow. for some users.

Original message was deleted

RAGman•3/28/24, 6:42 PM

I should have mentioned that I'm using presigned urls. Wouldn't it keep the Worker running throughout the entire upload to upload through a worker?

rootalien•3/28/24, 6:42 PM

I think I should use R2 for an HLS software without using cloudflare stream, is that right?

rootalien•3/28/24, 6:43 PM

When I manage to upload .ts files or .mp4 files to r2, there will be no slowdown even if there are high visitors?

rootalien•3/28/24, 6:43 PM

high download times.

UUnsmart I actually don't think that status is related to getting 10001 errors from R2. R...

dave•3/28/24, 6:46 PM

When a put fails with 1000110001, is it throwing on r2bucket.putr2bucket.put, or should only the promise just be returning null?

CChaika If it helps I have an auto updating api mapping IATA Code -> nearby region here:...

dave•3/28/24, 6:47 PM

what is generating https://colo.cloudflare.chaika.me/?iataregion ?

rootalien•3/28/24, 6:47 PM

Each .ts file is already 1MB, but as I said, when there are high visitors, there are high download times.

rootalien•3/28/24, 6:48 PM

I use cache because the file is small anyway.

rootalien•3/28/24, 6:59 PM

20-50mb is too high for a simple .ts file.

Ddave what is generating https://colo.cloudflare.chaika.me/?iataregion ?

ChaikaOP•3/28/24, 7:01 PM

Logpush and an load balancer monitor from all colos
It's all open source here:
https://github.com/Tyler-OBrien/Action-Delay-API/tree/main/scripts/logpush-colo-data
edge_log_queueing and logpush go into the D1 DB, cf-colo-handler is what serves colo.cloudflare.chaika.me and finds all of the airports to make a pretty response

rootalien•3/28/24, 7:03 PM

In which HLS software is the .ts file 50mb?

dave•3/28/24, 7:17 PM

If I want to put a large file (up to 100MB) into 5 different R2 buckets, is this the most efficient possible way of doing it?

let body_stream_1, body_stream_2, body_stream_3, body_stream_4, body_stream_5;
let body_stream_user = body_stream;
[body_stream_1, body_stream_user] = body_stream_user.tee();
[body_stream_2, body_stream_user] = body_stream_user.tee();
[body_stream_3, body_stream_user] = body_stream_user.tee();
[body_stream_4, body_stream_user] = body_stream_user.tee();
body_stream_5 = body_stream_user;

const r2_put_prom_1 = r2_bucket_1.put(md5_str, body_stream_1, put_options);
const r2_put_prom_2 = r2_bucket_2.put(md5_str, body_stream_2, put_options);
const r2_put_prom_3 = r2_bucket_3.put(md5_str, body_stream_3, put_options);
const r2_put_prom_4 = r2_bucket_4.put(md5_str, body_stream_4, put_options);
const r2_put_prom_5 = r2_bucket_5.put(md5_str, body_stream_5, put_options);

const r2_put_1 = await r2_put_prom_1;
const r2_put_2 = await r2_put_prom_2;
const r2_put_3 = await r2_put_prom_3;
const r2_put_4 = await r2_put_prom_4;
const r2_put_5 = await r2_put_prom_5;

let body_stream_1, body_stream_2, body_stream_3, body_stream_4, body_stream_5;
let body_stream_user = body_stream;
[body_stream_1, body_stream_user] = body_stream_user.tee();
[body_stream_2, body_stream_user] = body_stream_user.tee();
[body_stream_3, body_stream_user] = body_stream_user.tee();
[body_stream_4, body_stream_user] = body_stream_user.tee();
body_stream_5 = body_stream_user;

const r2_put_prom_1 = r2_bucket_1.put(md5_str, body_stream_1, put_options);
const r2_put_prom_2 = r2_bucket_2.put(md5_str, body_stream_2, put_options);
const r2_put_prom_3 = r2_bucket_3.put(md5_str, body_stream_3, put_options);
const r2_put_prom_4 = r2_bucket_4.put(md5_str, body_stream_4, put_options);
const r2_put_prom_5 = r2_bucket_5.put(md5_str, body_stream_5, put_options);

const r2_put_1 = await r2_put_prom_1;
const r2_put_2 = await r2_put_prom_2;
const r2_put_3 = await r2_put_prom_3;
const r2_put_4 = await r2_put_prom_4;
const r2_put_5 = await r2_put_prom_5;

Ddave If I want to put a large file (up to 100MB) into 5 different R2 buckets, is this...

Isaac McFadyen•3/28/24, 7:30 PM

You might be able to do a Promise.all on the puts.

Isaac McFadyen•3/28/24, 7:30 PM

Unsure.

IIsaac McFadyen You might be able to do a Promise.all on the puts.

dave•3/28/24, 7:30 PM

I'm noticing that there's a surprisingly high number of failures on the puts

dave•3/28/24, 7:31 PM

like I see one every couple of minutes

rootalien•3/28/24, 7:37 PM

Does cloudflare have a service that competes with cloudfront?

Rrootalien Does cloudflare have a service that competes with cloudfront?

dave•3/28/24, 7:43 PM

yes, cloudflare's cdn competes with cloudfront

rootalien•3/28/24, 7:44 PM

But when there are high visitors on cloudflare cdn, high loading times occur. How will we overcome this?

rootalien•3/28/24, 7:48 PM

%75

rootalien•3/28/24, 7:48 PM

rootalien•3/28/24, 7:48 PM

rootalien•3/28/24, 7:49 PM

When my cached files are high in visitors, a 2MB file is loaded in 40 seconds.

rootalien•3/28/24, 7:50 PM

My software does not allow this.

rootalien•3/28/24, 7:50 PM

There are sites that have no problems with this. Should I buy business for this?

rootalien•3/28/24, 7:50 PM

Even when we upload any file / image / video on Discord, cloudflare uses cache.

rootalien•3/28/24, 7:52 PM

Yes, but the loading time is due to cloudflare placing ToS on HLS software. It blocks this, so I ask if there is a service it doesn't block. I will pay for this.

Karew•3/28/24, 7:53 PM

Do you have an example file link that is having this problem?

rootalien•3/28/24, 7:53 PM

For example, if there are 1000 users on my website at the same time, only 100 of them have this high loading rate.

rootalien•3/28/24, 7:54 PM

I can't show you this because I don't have high visitors on my site right now.

rootalien•3/28/24, 7:54 PM

turkey

Karew•3/28/24, 7:54 PM

Right but I want to see if the file is being cached at all, do you have an example link?

KKarew Right but I want to see if the file is being cached at all, do you have an examp...

rootalien•3/28/24, 7:55 PM

cf-cache-status: HIT bro

Original message was deleted

rootalien•3/28/24, 7:55 PM

what's this

rootalien•3/28/24, 7:55 PM

GFW v2?

rootalien•3/28/24, 7:56 PM

why

rootalien•3/28/24, 7:57 PM

Yes I know that, unfortunately

rootalien•3/28/24, 7:57 PM

So, is this problem implemented by Turkey and not by cloudflare?

rootalien•3/28/24, 7:58 PM

ahahah no

rootalien•3/28/24, 7:58 PM

legal project

rootalien•3/28/24, 7:58 PM

If you do anything illegal in Turkey, your example.com main domain will be banned first.

rootalien•3/28/24, 7:59 PM

example.com banned next > cdn.example.com/hls.m3u8 ban

rootalien•3/28/24, 7:59 PM

Would you believe it? Even r2.dev is disabled, I noticed it now.

let body_stream_1, body_stream_2, body_stream_3, body_stream_4, body_stream_5; let body_stream_user = body_stream; [body_stream_1, body_stream_user] = body_stream_user.tee(); [body_stream_2, body_stream_user] = body_stream_user.tee(); [body_stream_3, body_stream_user] = body_stream_user.tee(); [body_stream_4, body_stream_user] = body_stream_user.tee(); body_stream_5 = body_stream_user; const r2_put_prom_1 = r2_bucket_1.put(md5_str, body_stream_1, put_options); const r2_put_prom_2 = r2_bucket_2.put(md5_str, body_stream_2, put_options); const r2_put_prom_3 = r2_bucket_3.put(md5_str, body_stream_3, put_options); const r2_put_prom_4 = r2_bucket_4.put(md5_str, body_stream_4, put_options); const r2_put_prom_5 = r2_bucket_5.put(md5_str, body_stream_5, put_options); const r2_put_1 = await r2_put_prom_1; const r2_put_2 = await r2_put_prom_2; const r2_put_3 = await r2_put_prom_3; const r2_put_4 = await r2_put_prom_4; const r2_put_5 = await r2_put_prom_5;

If it helps I have an auto updating api mapping IATA Code -> nearby region here: https://colo.cloudf

Similar Threads