How to stream via OPENAI BASE URL?
Does the OPENAI BASE URL support Server-sent events (SSE) type of streaming?
I was working previously with Ooba streaming was working fine. Since we switched to vLLM/Serverless it is no longer working.
If this is not done via SSE, Is there perhaps any tutorial you could recommend how to achieve streaming, please?
I was working previously with Ooba streaming was working fine. Since we switched to vLLM/Serverless it is no longer working.
If this is not done via SSE, Is there perhaps any tutorial you could recommend how to achieve streaming, please?
