What's the reason of `'Transfer-Encoding': 'chunked'` header getting ignored on Workers?

What's the reason of

'Transfer-Encoding': 'chunked'

'Transfer-Encoding': 'chunked'

'Transfer-Encoding': 'chunked'

'Transfer-Encoding': 'chunked' header getting ignored on Workers?

Ddbdplayer ``` fetch("https://imagedelivery.net/VERY_COOL_URL") .then(response => res...

Isaac McFadyen•5/6/22, 1:49 AM

Why are you doing blob?

Isaac McFadyen•5/6/22, 1:49 AM

imagedelivery.net will automatically return the correct Content-Type.

Isaac McFadyen•5/6/22, 1:49 AM

Just return the fetch() directly

XXiNiHa What's the reason of `'Transfer-Encoding': 'chunked'` header getting ignored on ...

XiNiHaOP•5/6/22, 1:59 AM

Is it just Workers not supporting chunked stream response?

XiNiHaOP•5/6/22, 2:15 AM

Purchased the paid plan and changed it to Unbound just in case, now the app is completely broken

XiNiHaOP•5/6/22, 2:19 AM

Well now the bundled mode is also broken, I'm goingcrazy

Erwin•5/6/22, 2:19 AM

How did moving to a paid plan break your worker?

XiNiHaOP•5/6/22, 2:20 AM

It just never responds (didn't wait that long to check if it's a problem that I had before)

XiNiHaOP•5/6/22, 2:20 AM

Let me republish the app just in case the compat flags are resetted

Erwin•5/6/22, 2:21 AM

Oh.. that would be an interesting bug if that was the case..

XiNiHaOP•5/6/22, 2:21 AM

Yeah that was it I guess

XiNiHaOP•5/6/22, 2:21 AM

Now working again

Erwin•5/6/22, 2:21 AM

Can you switch plans and see if that breaks again?

XiNiHaOP•5/6/22, 2:22 AM

Yeah it breaks

Erwin•5/6/22, 2:22 AM

Or if it is only the upgrade to a paid plan that does that

XiNiHaOP•5/6/22, 2:22 AM

Let me republish again

XiNiHaOP•5/6/22, 2:22 AM

Well looks like changing the usage model resets all the compat flags

XiNiHaOP•5/6/22, 2:22 AM

republished and working again

Erwin•5/6/22, 2:23 AM

Well.. that isn't looking very good is it? Reporting it right now

Erwin•5/6/22, 2:23 AM

Thanks for that!

XiNiHaOP•5/6/22, 2:23 AM

Btw the Transfer-Encoding: chunkedTransfer-Encoding: chunked is still not getting applied

XiNiHaOP•5/6/22, 2:24 AM

And this significantly breaks React streaming SSR

Erwin•5/6/22, 2:40 AM

Hmm.. if you are writing through a stream, only Transfer-Encoding: chunkedTransfer-Encoding: chunked makes sense right?

XiNiHaOP•5/6/22, 2:58 AM

Yeah it must be chunked to get advantages from it

XiNiHaOP•5/6/22, 2:59 AM

I both tried passing ReadableStream directly and piping it using TransformStream but both didn't work

XXiNiHa I both tried passing ReadableStream directly and piping it using TransformStream...

Erwin•5/6/22, 3:19 AM

Let me get around to that after we resolve the other incident first

Erwin•5/6/22, 3:25 AM

There we go @xiniha

https://discord.com/channels/595317990191398933/895794943182909470/971975799458648114

XiNiHaOP•5/6/22, 3:26 AM

Great

Curtis Doty•5/6/22, 3:40 AM

Hi all. I'm building a webhook worker to translate between two cloud services. I've set up everything and tested, but not getting any POSTs from the source service. It's Peplink's IC2 service. https://incontrol2.peplink.com/ They claim they are successfully sending the HTTP POSTs, but I have nothing in the logs. I'm even debugging to KV and seeing nothing. They claim that CloudFlare is blocking IC2 requests. I don't think I have any bot filters or firewall running. Any ideas?

CCurtis Doty Hi all. I'm building a webhook worker to translate between two cloud services. I...

Erwin•5/6/22, 3:57 AM

Well.. I assume you have done the "Test service manually with curl or postman".. and double checked the URLs?

Erwin•5/6/22, 3:59 AM

And what do they mean by successfully? Do they get back a 200? Do you have overlapping routes, where something goes to another worker than you think it does?

EErwin There we go @xiniha 😄 https://discord.com/channels/595317990191398933/895794943...

Walshy•5/6/22, 4:09 AM

Erwin always causing incidents

WWalshy Erwin always causing incidents

Erwin•5/6/22, 4:10 AM

Tbh I am a little surprised there hasn't been a massive push by the teams for Albert to ban me from Discord, seeing how many incidents I have brought them from here

Walshy•5/6/22, 4:11 AM

Ddbdplayer ``` fetch("https://imagedelivery.net/VERY_COOL_URL") .then(response => res...

Walshy•5/6/22, 4:13 AM

You can’t return within the promise (since it’s async). You’d want to await that and then handle.

Erwin•5/6/22, 4:29 AM

What is not having what? And where does myHeaders come from? And what happens in handleResponse?

Erwin•5/6/22, 4:53 AM

And what is the problem exactly?

XXiNiHa Yeah it must be chunked to get advantages from it

XiNiHaOP•5/6/22, 7:12 AM

New fact here - Chrome just renders the page as they arrive in the stream, while Firefox and Safari requires Transfer-Encoding: chunkedTransfer-Encoding: chunked (they otherwise block rendering until the stream ends)

XiNiHaOP•5/6/22, 7:12 AM

Maybe that's the reason why the problem was not spotted - since most people use Chrome