Is a worker well suited for streaming chatGPT responses?
I want to stream responses back to users using Web Streams API in a worker. I'm on a free plan at present which doesn't allow workers running for long in any way. Do you think workers are better suited for immediate responses instead of text streaming cases like mine?
3 Replies
If you are just directly streaming a Response, then it shouldn't be an issue. It only becomes more difficult if you need to modify the stream while it is running?
do you mean that time limitations do not apply when you're passing a stream from an external source? Is there a price burden though?
Nope. It should stay within the free tier, as long as you don’t get more than 100k requests a month