Let me check just to be sure, but if you do need to move, there is `rclone`, or Slurper for the mana

Let me check just to be sure, but if you do need to move, there is

rclone

rclone

, or Slurper for the managed version

HHard@Work Let me check just to be sure, but if you do need to move, there is `rclone`, or ...

fritex•12/19/24, 6:02 PM

Appreciate in advance! Thank you for feedback

Original message was deleted

Hard@WorkOP•12/19/24, 6:03 PM

I mean, for a few hundred gigs, unless you have a great connection, it might still take a while

Original message was deleted

fritex•12/19/24, 6:04 PM

Had no clue for this!
Will give it a try for sure
I do have 1Gbps connection from home and server as well
Used rclone 1st time, was quite fast for approx. ~2mil files and ~160GB vs aws-cli which took me a full day for only ~50GB and ~1mil

Original message was deleted

Hard@WorkOP•12/19/24, 6:05 PM

Huh, weird. Might be doing something wrong, but seems to pull via my device for me

Original message was deleted

Hard@WorkOP•12/19/24, 6:05 PM

Yep, same bucket too

Ffritex Appreciate in advance! Thank you for feedback

Hard@WorkOP•12/19/24, 6:06 PM

Just confirmed, if you need GDPR compliance, then you should use the EU jurisdiction

HHard@Work Just confirmed, if you need GDPR compliance, then you should use the EU jurisdic...

fritex•12/19/24, 6:08 PM

Got it, thank you for such fast check and response! I'll write down this information for a reminder for my further buckets.

fritex•12/19/24, 6:10 PM

May I also ask, since I haven't tested much yet, is there any difference for EU jurisdiction bucket, e.g. are files served from EU IP addresses?
https://community.cloudflare.com/t/site-ip-address-changes-very-often/374169/4 -> reminds me onto this and then I wonder if I'd have some issues, with some ISPs blocking or limiting Cloudflare ...

fritex•12/19/24, 6:10 PM

Or it just does mean that the data is being kept inside the EU location(s) for the buckets.

Original message was deleted

fritex•12/19/24, 6:12 PM

May I use this opportunity and ask if there is any difference, or need for this to get it work in the config file for rclone?

Or just define and use R2 API Token which can access read-write for both buckets?

Original message was deleted

fritex•12/19/24, 6:13 PM

Got it, thank you for feedback and help

tokie•12/19/24, 6:13 PM

I asked yesterday but didn't provide an example. I have this R2 custom domain setup automatically by "connecting" it. It's returning a 301 for any URL back to the URL requested. Here's an example: https://sniff.lololo.lol/hello.txt -- I have checked every set of config for the zone and there's no page rules / redirects / etc.

Original message was deleted

Hard@WorkOP•12/19/24, 6:14 PM

Weird

Original message was deleted

tokie•12/19/24, 6:15 PM

there's no redirects enabled for the domain -- except maybe those for https in the ssl config

tokie•12/19/24, 6:16 PM

does r2 only work over http ?

tokie•12/19/24, 6:16 PM

i disabled https rewrites an hour ago

tokie•12/19/24, 6:17 PM

"Automatic HTTPS Rewrites" in the edge certs section that is

Ttokie I asked yesterday but didn't provide an example. I have this R2 custom domain se...

Chaika•12/19/24, 6:19 PM

Your SSL/TLS mode is "Off"

CChaika Your SSL/TLS mode is "Off"

tokie•12/19/24, 6:19 PM

AHAH

tokie•12/19/24, 6:19 PM

thanks!

Chaika•12/19/24, 6:20 PM

should go Full (Strict) or Strict (SSL-Only)

Original message was deleted

Chaika•12/19/24, 6:20 PM

enough to disable the redirect? sure.
something you should use in production? never

tokie•12/19/24, 6:20 PM

yeah, it was disabled and then http->https redirects were enabled

tokie•12/19/24, 6:20 PM

so it got into a little loopies

Chaika•12/19/24, 6:24 PM

I thought R2 Custom Domains were HTTPS only/enforced by the zone under the R2 Custom Domain, evidently not tho

Original message was deleted

Hard@WorkOP•12/19/24, 6:25 PM

This is via the latest

rclone

rclone

via Homebrew, so it should

be up to date

Hard@WorkOP•12/19/24, 6:25 PM

Will check later

Original message was deleted

Hard@WorkOP•12/19/24, 6:26 PM

I have an old key, and no region, but otherwise same

Original message was deleted

Hard@WorkOP•12/19/24, 6:27 PM

Isn't Server-Copy a standard thing for S3?

Original message was deleted

Hard@WorkOP•12/19/24, 6:29 PM

Can

rclone

rclone

do Multipart Copy?

fritex•12/19/24, 6:42 PM

May I ask could we expect somewhere in future to be able to filter buckets on the bucket list, e.g. per location / jurisdiction?

Might be it's able to do it via API, but not on the Dashboard, yet.
Thank you!

fritex•12/19/24, 6:50 PM

If we have e.g. sub-domain on bucket, example:
a) mydomain.hr is main domain
b) then I've got sub-domain sub.mydomain.hr
c) for r2.sub.mydomain.hr -> do I need to pruchase Advanced Certificate Manager to cover that R2 Custom domain which seems to me to be an deep-level sub-domain?

Original message was deleted

Eric Ellis•12/19/24, 6:51 PM

I wonder if this is related to my issue...

EEric Ellis Hello, I've just configured an R2 storage bucket and seeing some failures (inter...

Eric Ellis•12/19/24, 6:52 PM

here

Eric Ellis•12/19/24, 6:52 PM

it's a periodic seize up issue

Eric Ellis•12/19/24, 6:52 PM

just goes non responsive

Eric Ellis•12/19/24, 6:53 PM

i do the same operation maybe 500 times and it has various amounts of latency from non to 20 seconds to a full timeout

Eric Ellis•12/19/24, 6:53 PM

this is a get operation

Eric Ellis•12/19/24, 6:53 PM

very few

Eric Ellis•12/19/24, 6:54 PM

in what timeframe?

Eric Ellis•12/19/24, 6:54 PM

it depends on if a CI job is running. but typically none for a significant block of time

Eric Ellis•12/19/24, 6:54 PM

so when doing this test probably 0

Eric Ellis•12/19/24, 6:58 PM

when i did the rclone from digital ocean i was also seeing intermittent full hangs. not sure if that's similar to what you mentioned. at the time i couldn't tell if it was them or R2

Eric Ellis•12/19/24, 6:59 PM

should not be unstable...

Original message was deleted

fritex•12/19/24, 6:59 PM

It works! No need to purchase ACM

Tested few moments ago

Eric Ellis•12/19/24, 6:59 PM

yes but this just started happening when switching to R2. same application did not show this behavior with digital ocean

Eric Ellis•12/19/24, 7:00 PM

also since it's gitlab i can't easily change the code

Eric Ellis•12/19/24, 7:00 PM

not a runner. it's the server backend

Eric Ellis•12/19/24, 7:01 PM

which i am running self hosted