Re:Language models can explain neurons in language models
by DaiPlusPlus on Wednesday May 10, 2023 @12:24AM
(#35883628)
> But how is any information that isn't testable trusted? I'm open to the idea ChatGPT is as credible as experts in the dismal sciences given that information cannot be proven or falsified and legitimacy is assigned by stringing together words that "makes sense".
I understand that around the 1980s-ish, the dream was that people could express knowledge in something like Prolog, including the test-case, which can then be deterministically evaluated. This does really work, but surprisingly many things cannot be represented in terms of “facts” which really limits its applicability.
I didn’t opt for Prolog electives in school (I did Haskell instead) so I honestly don’t know why so many “things” are unrepresentable as “facts”.
Re:Language models can explain neurons in language models
by philomath_mn on Wednesday May 10, 2023 @01:21AM
(#35883930)
I bet GPT is really good at prolog, that would be interesting to explore.
"Answer this question in the form of a testable prolog program"
Re:Language models can explain neurons in language models
by DaiPlusPlus on Wednesday May 10, 2023 @03:26AM
(#35884689)
Did you give it a try?
Re:Language models can explain neurons in language models
by falsissime on Thursday May 11, 2023 @01:40PM
(#35905530)
You lost this bet: Write append3/4 which appends three lists to a fourth, such that append3(Xs,Ys,[e],[]) terminates.
It seems NN output could be trusted in scenarios where a test exists. For example: "ChatGPT design a house using [APP] and make sure the compiled plans comply with structural/electrical/design/etc codes for area [X]".
But how is any information that isn't testable trusted? I'm open to the idea ChatGPT is as credible as experts in the dismal sciences given that information cannot be proven or falsified and legitimacy is assigned by stringing together words that "makes sense".