News for hackers. Stuff that matters.
Re:Building Boba AI: Lessons learnt in building an LLM-power... by senko on Thursday June 29, 2023 @03:40PM (#36525683)
It's a crutch to minimize the user annoyance at having to wait up to a minute for the response. It sure beats the spinner but it's still a crutch.
Re:Building Boba AI: Lessons learnt in building an LLM-power... by thelittleone on Friday June 30, 2023 @03:07AM (#36531517)
Really? I feel like in most uses the stream is close to, if not slightly faster than my reading. I actually prefer that over an instant full-page response. It helps me keep my place in the text and feels like reduced cognitive load.
Re:Building Boba AI: Lessons learnt in building an LLM-power... by golergka on Friday June 30, 2023 @04:43AM (#36532128)
Also, the vibrations when LLM “types” in OpenAI iOS app are so satisfying for some reason. It may be a stupid subjective thing, but from my experience in game dev, that's exactly the kind of detail that creates the overall user experience feeling.