You could shard across many buckets instead.
You could shard across many buckets instead.
HThought I definitely would not recommend using KV to cache images from R2. It effectively generates double the cost for basically the same performance. If you do find that KV is faster for your usecase, and all your images fit in KV, then you can just store them in KV, omitting R2 entirely
DCouldn’t he use public buckets with caching and a WAF HMAC on top?
DJust note that caching will not work if you use presigned URLs on R2.
Dis r2 having issues right now?
JHi. I'm looking at moving from Google Cloud Storage to R2, primarily for the cost difference. Currently with Google we create a bucket per user but this isn't supported by default with R2 due to the inital bucket limit per account. I found this message (r2) stating that the current recommended way to achieve this in R2 is to use a UID prefix to create a "folder" per user however this presents issues when you want to delete a user's data and puts the burden of user usage collection on us.
Is this still the recommended way to structure user data in R2 and how likely are Cloudflare to increase the bucket limit for reasons such as this?
Also as I understand it at the moment there is no data replication with R2. Does this mean there is no protection against datacenter disasters?
Is this still the recommended way to structure user data in R2 and how likely are Cloudflare to increase the bucket limit for reasons such as this?
Also as I understand it at the moment there is no data replication with R2. Does this mean there is no protection against datacenter disasters?
KCreating a bucket per user sounds like a bad idea in every blob storage service, not just R2. The prefixes are exactly what you should do. Deleting the user data should be easy since you can delete based on a prefix.
R2 does have disaster recovery internally, we don't have user-facing replication (like you can't have two buckets on your account that automatically copy each other)
R2 does have disaster recovery internally, we don't have user-facing replication (like you can't have two buckets on your account that automatically copy each other)
KR2 analytics can also be filtered on the prefix. If each user has a UUID, there would be no possibility of overlap
JThat sounds perfect. I've not used the S3 API properly before. Is the only way to delete the files by prefix by using a lifecycle configuration? I couldn't see anything related to it on the standard delete object requests.
JGot it. Thanks for the help!
EYes but you may need to add some code for it - https://developers.cloudflare.com/workers/reference/how-the-cache-works/
EFor image resizing, check here https://developers.cloudflare.com/images/transform-images/transform-via-workers/
EThen on the dashboard, purchase the $0+usage plan of Cloudflare Images (which allows you to use your own storage)
EYou use the $0 plan to enable Transforms and then use those in a Worker with your R2 as the storage, check this link again https://developers.cloudflare.com/images/transform-images/transform-via-workers/
ECorrect
