News for hackers. Stuff that matters.

A comment on Ask HN: People who were laid off or quit recently, how are you doing?. Parent comment

Re:Ask HN: People who were laid off or quit recently, how ar... by dpflan on Thursday April 20, 2023 @01:36PM (#35643396)
A glaring problem is: Non-determinism of LLMs, creating different answers to the same prompt. I appreciate your blogging and analysis in this space, so I am I am interested in your responses. The non-determinism implies that prompt engineering is brittle, difficult, and prone to no formal evaluation techniques for correctness.
[ Parent | on HN ]
Re:Ask HN: People who were laid off or quit recently, how ar... by simonw on Thursday April 20, 2023 @03:43PM (#35645230)
I agree with everything you've said there.
[ Parent | on HN ]
Re:Ask HN: People who were laid off or quit recently, how ar... by dpflan on Thursday April 20, 2023 @04:32PM (#35645867)
It is certainly an interesting phenomenon, and I wonder what techniques from neuroscience for brain mapping could be used for model "brain mapping", which could lend itself more to prompt engineering as a science (latent space mapping).
[ Parent | on HN ]
Re:Ask HN: People who were laid off or quit recently, how ar... by jaredsohn on Monday April 24, 2023 @07:57AM (#35686503)
Set the temperature to zero to make it more deterministic.
[ Parent | on HN ]