News for hackers. Stuff that matters.

A comment on What We Learned from a Year of Building with LLMs. Parent comment

Re:What We Learned from a Year of Building with LLMs by distalx on Wednesday May 29, 2024 @03:19AM (#40509364)
In my opinion, using templates can help keep responses reliable. But it can also make interactions feel robotic, diminishing the "wow" factor of LLMs. There might be better options out there that we haven't found yet.
[ Parent | on HN ]
Re:What We Learned from a Year of Building with LLMs by DubiousPusher on Wednesday May 29, 2024 @01:39PM (#40514626)
Absolutely. This is a huge trade-off. The constraints you place on the model output is all about how much your app and user experience can tolerate bad LLM behavior.
[ Parent | on HN ]