R
RunPodiNF3Rnus

Are stream endpoints not working?

This is a temp endpoint just to show you all. /stream isn't available, what's up?
No description
I
iNF3Rnus44d ago
Potentially nevermind, I think I understand now... You start an async job with run, then get the id from that, and retrieve the results with stream/{job_id} Based off of testing this in Postman, I don't think this supports actual streaming, or am I mistaken? I need these endpoints for LLMs for use with a FE application and I want to literally stream tokens text/event-stream style, is that supported?