Re:Understanding GPT Tokenizers
by kordlessagain on Friday June 09, 2023 @08:48AM
(#36257073)
Thought can be seen as a process that encompasses both rational and irrational thinking. Rational thought, in programming languages, involves precise logic, determinism, and the ability to simulate outcomes. On the other hand, human language, like English, embraces subjective interpretation and approximations, allowing for the expression of emotions and nuanced understanding.
Thought, as a cognitive process, can bridge the gap between these two realms, enabling individuals to move back and forth between rational and irrational modes of thinking, depending on the context and objectives at hand.
With data, unstructured text could be considered "irrational" and structured text (like code or a column in a database) could be considered "rational".
Thought, as a cognitive process, can bridge the gap between these two realms, enabling individuals to move back and forth between rational and irrational modes of thinking, depending on the context and objectives at hand.
With data, unstructured text could be considered "irrational" and structured text (like code or a column in a database) could be considered "rational".