Hi

Hi this bug could only reproduce by upload the exact files I uploaded. because it not caused by 按照RJ号命名的作品 but the files in it. I have already tried rclone lsd config-name:bucket-name/voices/voice/按照RJ号命名的作品/, and the issue still exist(hang forever). To avoid being a problem with rclone, I specifically said that upload and check in the dashboard
18 Replies
Sid
Sid3y ago
So the contents/body of the object shouldn't matter here, because the dashboard is really just doing a ListObjects, which won't touch object bodies. Is this by any chance the same "directory" where you saw duplicate files?
koreyoshi_re
koreyoshi_reOP3y ago
Yes, this is also one of the directory that duplicate
Sid
Sid3y ago
If anything, it could be the name of the object inside this "folder" that is causing problems
koreyoshi_re
koreyoshi_reOP3y ago
but I cant reproduce the "duplicate" issue and see this issue instead 😂
Sid
Sid3y ago
Could you send me your account ID? You'll find it in all dashboard URLs: https://dash.cloudflare.com/<account-id>/r2/overview/buckets/test-bucket They're not secrets, so it is safe to send it over here
koreyoshi_re
koreyoshi_reOP3y ago
ok it was b641b39a1746f9124aeb6d3d6acfb093
Sid
Sid3y ago
Huh, so I do see your problem in our logs. This looks like messed up unicode parsing on our end, I'll look into this shortly In fact, I'm able to repro it now, so thanks so much for reporting! Hey so I just wanted to let you know that I am looking into this today, sorry for the delay. Unfortunately, even if I fix it today, this can only go out next week, I'll let you know when that happens!
koreyoshi_re
koreyoshi_reOP3y ago
Thank you so much for letting me know 🥰 oh one more question. How about duplicate problems and 'never uploaded' problems , are they happen because the same encoding issue?
Sid
Sid3y ago
The duplication issue is likely related. The object isn't actually duplicated, our ListObjects implementation had a bug that makes it look that way. The issue had to do with Unicode normalization, so it is likely the "never uploaded" issue is also related How about you give it another shot when my fix goes out next week?
koreyoshi_re
koreyoshi_reOP3y ago
Sure
Sid
Sid3y ago
Hey there, a release with this fix is finally out, mind re-checking? Your ListObjects request should no longer time out.
koreyoshi_re
koreyoshi_reOP3y ago
will re-check now - ListObjects: OK - duplicate issue: still exist on my production bucket, and can't repro on other bucket
Sid
Sid3y ago
Halfway there! Can you copy the names of the objects that are duplicated and send them to me? Feel free to DM me if you don't want to share here. I have a feeling this is still a Unicode issue
koreyoshi_re
koreyoshi_reOP3y ago
sorry, that might be a rclone issue.. for the old version of rclone: - I could always repro the issue consistently in my production bucket (by delete and upload agian) - but I can't repro it at the test bucket (all other env is the same: machine, rclone, file source etc.) (that's why I don't think is a rclone issue at first) For the new version of rclone. - The problem goes away immediately and there is no need to re-upload files or do anything else.
koreyoshi_re
koreyoshi_reOP3y ago
No description
Sid
Sid3y ago
Oh cool, I'll consider this resolved then. Let me know if you see this again!
koreyoshi_re
koreyoshi_reOP3y ago
Sure Thank you for your efforts on R2, this product really helped me a lot.
Sid
Sid3y ago
Awesome 🎉

Did you find this page helpful?