News for hackers. Stuff that matters.

A comment on AI Language Models Are Struggling to “Get” Math. Parent comment

Re:AI Language Models Are Struggling to “Get” Math by mjburgess on Thursday October 13, 2022 @03:43AM (#33188332)
> 500 bn parameter model

That solution has a compressed representation of half the internet.

NNs are "garabled nonesense" insofar as they try to generalise; insofar as they are search engines, they provide apparent sense by just repeating something in their database (= weights).

Google, likewise, returns joke explanations.

[ Parent | on HN ]
Re:AI Language Models Are Struggling to “Get” Math by 1024core on Friday October 14, 2022 @08:41PM (#33210439)
"The Internet" is much, much bigger than 500bn floats. The latest snapshot of archive.org has 505 billion web pages itself.
[ Parent | on HN ]