Oh, interesting. Yeah, it's happening only with JSON files for me actually
Oh, interesting. Yeah, it's happening only with JSON files for me actually
Gmight be a coincidence though
Dthe thing is my PDF files are being uploaded "slower", since I'm tee'ing to create 3 ReadableStreams and uploading them to two R2 buckets, and Azure.
Dso maybe the pressure thingy of a Worker is reducing the odds of an error?
Chowdy all, I have a quick question about large downloads from r2 just failing mid download. It only seems to happen for some users and for those users it happens all the time.
CI guess I'll have to build that functionality out.
CThis caught me off guard tbh, I went months with no issues in our playtest bucket and when we switched over to the prod one (everything is the same except the name), we had issues up wazoo with the exact amount of users.
CHm, how do issues like that look?
CLike is there some documentation of a limit, or it's more of a quirk
CZoinks
CWell, let's see how it all goes then.
CWe're going "live" soon and I guess we'll be scrambling to reply to people to let them know whats up
GTo add insult to injury, if you do uploads from a Worker, you can't even retry a failed R2 write in most cases
GBecause the stream is gone (if it was coming from the user)
Gor you read it into memory and hope you don't hit the poorly-documented 128MB memory limit
GI think we'll be migrating to S3 for our production workloads, this is simply too unreliable. I'm actually having trouble imagining someone running a production service on R2 as it exists today
Gunless you're just happy accepting the unreliability
Gyep
Dwe're tee'ing to two R2 buckets at once, so in theory we can write a cron Worker that syncs the two up later... kinda ugly and is now 2x the storage though.
Dwhat do you mean?
JHey guys, very new to R2. Any recommendations for uploading big files?. Thanks
JCould you point me to some docs to learn about it?
DI personally prefer splitting the file in the application instead of using multipart files.
JThank you
Dis this wnam too?
DSo I managed to delete my 1tb of data from r2... except for a few "Ongoing Multipart Upload" which weirdly appear to be 3.94 GB in size! I can't delete these using the gui and I can't delete them using rclone..... any ideas?
Dno
DI hadnt thought about this, thank you!
Zdoes it say "network error" or "transfer closed"?
Cits happening inside of an "embedded" application and due to me having bad logging i cant say for sure.
Cthis is like
C90% my skill issue
ZI don't know if they've fixed it yet
Cfixed what?
Yguys your discussion is starting to make me worry xd
YI'm planning on using r2 in production
Ybut I'm only uploading images so no big files there
Yalso I won't have a lot of concurrent uploads happening
YI'm not using workers, just the s3 api
Ymost of my traffic will come from download requests and not upload ones
Yso I hope no one had issues there
Yusing jmeter for example?
YI've used it and the results have been pretty satisfying
Yalright thanks, I will look into k6 and will hopefully try to make a good estimate for launch day
!
SI am not sure why this R2 CDN link is not working http://cdn.strongmindbraveheart.com/category/posts
DNS setup looks okay to me. Help!
DNS setup looks okay to me. Help!
SI have a few other sites with the same setup, and they all are working fine.
SNot sure what is going on with this one.
SIt has been working fine, and then we tried with a new setup with a new CNAME targeting for the remote site.
Spointed the main domain CNAME to ns-1826.awsdns-36.co.uk
SOkay, it could be related to this, but even if I remove this CNAME, it still does not work.