News for hackers. Stuff that matters.
Re:OpenAI: Streaming is now available in the Assistants API by Kiro on Thursday March 14, 2024 @03:39AM (#39701385)
How is hiding it behind a loading spinner any better? You still can't spam it with questions since you need to wait for it to finish. With streaming you can at least hit the stop button if it looks incorrect, so you actually spam it more with it enabled.
Re:OpenAI: Streaming is now available in the Assistants API by silversmith on Thursday March 14, 2024 @06:46AM (#39702254)
For me, the constant visual changes of new parts being streamed in are annoying, and straining on the eyes. Ideally, web frontends would honor `prefers-reduced-motion` and buffer the response when set.
Re:OpenAI: Streaming is now available in the Assistants API by Prosammer on Thursday March 14, 2024 @07:26AM (#39702497)
Personally, I've fallen in love with that visual effect of streaming text you're talking about. It's a bit pavlovian, but I think in my head it signifies that I'm reading something high signal (even though it isn't always).