News for hackers. Stuff that matters.
Re:Are language models deprived of electric sleep? by trention on Saturday July 23, 2022 @07:25PM (#32208583)
>The existence of the sentiment ‘lol you trained a big model on X so obviously it produces a good probability distribution on X’ only exists because big models proved to be extraordinarily more effective than anyone expected.

No, the "popularity" of that sentiment exists because of their "effectiveness". That sentiment was existing and being voiced 10 years ago.

Re:Are language models deprived of electric sleep? by benreesman on Saturday July 23, 2022 @08:12PM (#32208904)
You’ve stated this point better than I did.

Otherwise brilliant and rational people just go all mystical when we start talking about meaningless words like “intelligence” or “consciousness”.

An animal or a human or a big matrix perform X well on Y task. That’s quantitative and objective.

All this “is it smart” bullshit is thinly-veiled “how does the world still rotate around my subjective experience given this thing writes better Tolkien fan fiction than I do”.

Performance on tasks. Everyone else shuffle over to the Philosophy department.