Re:Nuclear fusion: WEST beats the world record for plasma du...
by fc417fc802 on Wednesday February 19, 2025 @07:13PM
(#43109540)
What is the metric to measure comprehension?
How are we disentangling comprehension of natural language itself from comprehension of the subject matter being discussed via said language sample?
I think that by most reasonable metrics LLMs can reasonably be said to comprehend natural language itself. However they clearly are deficient in logic and reasoning, as well as comprehension of many of the concepts that the natural language is used to express.
How are we disentangling comprehension of natural language itself from comprehension of the subject matter being discussed via said language sample?
I think that by most reasonable metrics LLMs can reasonably be said to comprehend natural language itself. However they clearly are deficient in logic and reasoning, as well as comprehension of many of the concepts that the natural language is used to express.