News for hackers. Stuff that matters.
Re:Some Remarks on Large Language Models – Yoav Goldberg by abarker on Tuesday January 03, 2023 @05:25PM (#34239017)
Conversely, these models open up philosophical questions of "exactly what a human is" beyond language abilities. How much of what we think, do, and perceive comes from the use of language?
Re:Some Remarks on Large Language Models – Yoav Goldberg by morelisp on Tuesday January 03, 2023 @06:16PM (#34239531)
They don’t “open” shit, the linguistic turn came and largely went long before they existed.
Re:Some Remarks on Large Language Models – Yoav Goldberg by visarga on Tuesday January 03, 2023 @06:40PM (#34239763)
I think most intelligence is in the language. We're just carriers. Language models too. What would a human be without language?
Re:Some Remarks on Large Language Models – Yoav Goldberg by bilsbie on Tuesday January 03, 2023 @11:08PM (#34241898)
> I think most intelligence is in the language. We're just carriers

This is such a profound idea. I’ve been wondering about that for a while. Is there anywhere to read up on it?

Re:Some Remarks on Large Language Models – Yoav Goldberg by mike_hearn on Wednesday January 04, 2023 @04:04AM (#34243541)
Isn't that just a rephrasing of the Sapir-Whorf hypothesis? If so then it's old and thoroughly debunked. Language features don't seem to influence the way we think, which is another way of saying that intelligence and language are different things. If you want to read about it you can look at the history of this idea in the 20th century from when it was proposed by linguists in the 1930s all the way up to the time it became discredited, as there are many research papers and even books on the topic.

One of the really troublesome problems with Sapir-Whorf and derivatives is that they led directly to some very nasty totalitarian behaviors. In "1984" a core policy of the Big Brother government is Newspeak, in which language changes are (believed to be) used to control the thoughts of the population and establish eternal power for the Party. This wasn't merely a quirky bit of fictional sci-fi, it was directly inspired by the actual beliefs of the hard left. The extent to which Newspeak was an accurate portrayal of life under the Nazis and Communists is explored in "Totalitarian language : Orwell's Newspeak and its Nazi and communist antecedents".

https://searchworks.stanford.edu/view/2016479

Today it's known that Sapir-Whorf isn't supported by the evidence, but there's still a strong desire on the political left to manipulate thought through language. Stanford's recent "Elimination of Harmful Language" initiative is a contemporary example of this intuition in practice. It doesn't work but it sounds so much easier than engaging in debate that people can't let it go.

tl;dr to the extent this has been studied already, intelligence is not in the language.

Re:Some Remarks on Large Language Models – Yoav Goldberg by bilsbie on Wednesday January 04, 2023 @12:04PM (#34248195)
I’m thinking of something different but you raise some good points regardless.