14 replies

thanks, any plans to increase those

thanks, any plans to increase those limits?

increasing limits is always on our list

too soon to provide a timeline here though. curious, what are you using Queues & workers for? how would larger batches help?

scottoOP•2/18/25, 3:36 PM

Great, in this case we it for storing data for model fine tuning, we receive data via API queue and process to store as batchs of jsonl

scottoOP•2/18/25, 3:37 PM

Those jsonl ends in R2

scottoOP•2/18/25, 3:40 PM

1000 would be nice for our use case

John Spurlock•2/18/25, 4:18 PM

similar in my case: lots of little requests coming in and getting queued, with the batch queue handler doing aggregate updates/inserts to R2. So increasing the batch limit translates directly to lower R2 put costs, 1000msg/2560kb would be fantastic

Pranshu Maheshwari•2/20/25, 8:59 PM

@scotto any chance you'd be interested in something new we're building? Quick sneak preview here

If yes, send me your account ID and I can get you setup (safe to share here)

Pranshu Maheshwari•2/20/25, 9:26 PM

it should make it much easier for you to build larger files in R2!

scottoOP•2/20/25, 9:56 PM

Would love to have access to that

Pranshu Maheshwari•2/24/25, 8:44 PM

could you send me your account ID @scotto? I'll get you enabled right away

scottoOP•2/24/25, 8:55 PM

here it's 920b1a6e159cf77dab28969103a4765b

Pranshu Maheshwari•2/24/25, 9:10 PM

just sent you an email with details @scotto

Pranshu Maheshwari•2/28/25, 7:43 PM

For sure - send me over your account ID or feel free to send me an email to pranshu @ cloudflare

thanks, any plans to increase those

Similar Threads

Similar Threads

Similar Threads