Entropy of a Large Language Model output

Re:Entropy of a Large Language Model output by EncomLab on Monday January 13, 2025 @12:53PM (#42686284)

A starting point would be a system that does not require the use of a limited set of pre-defined operations to transform from one state to another state via the interpretation of a set of pre-existing instructions. This rules out any digital system entirely.

[ Parent | on HN ]

Re:Entropy of a Large Language Model output by achierius on Monday January 13, 2025 @01:58PM (#42687166)

But what _would_ qualify? The point being made is that your definition is so constricting as to be useless. Nothing (sans perhaps true physical limit-conditions, like black-holes) would be a black box under your definition.

[ Parent | on HN ]

Re:Entropy of a Large Language Model output by EncomLab on Monday January 13, 2025 @03:35PM (#42688825)

It's really only constricting to state machines which are dependent upon a fixed instruction set to function.

[ Parent | on HN ]