News for hackers. Stuff that matters.

A comment on AI Language Models Are Struggling to “Get” Math. Parent comment

Re:AI Language Models Are Struggling to “Get” Math by 1024core on Wednesday October 12, 2022 @09:44PM (#33186188)
See the "joke explaining" examples on Page 36 of the paper: https://arxiv.org/abs/2204.02311 and tell me if it's just "passable garbled nonsense".
[ Parent | on HN ]
Re:AI Language Models Are Struggling to “Get” Math by riskneutral on Wednesday October 12, 2022 @09:57PM (#33186254)
That's astonishing.
[ Parent | on HN ]
Re:AI Language Models Are Struggling to “Get” Math by stevenhuang on Thursday October 13, 2022 @01:17AM (#33187529)
Oo this reminds me. One of my favourite sci-fi novels is The Moon is a Harsh Mistress.

In it, it depicts the growth of a nascent AI from its attempts at understanding humor. The AI befriends a technician and gets the human to rate its own crafted jokes.

Eventually the AI gets really good at telling jokes, and becomes sentient as a result.

It was a very fun take on AI gaining sentience, highly recommended!

[ Parent | on HN ]
Re:AI Language Models Are Struggling to “Get” Math by mjburgess on Thursday October 13, 2022 @03:43AM (#33188332)
> 500 bn parameter model

That solution has a compressed representation of half the internet.

NNs are "garabled nonesense" insofar as they try to generalise; insofar as they are search engines, they provide apparent sense by just repeating something in their database (= weights).

Google, likewise, returns joke explanations.

[ Parent | on HN ]
Re:AI Language Models Are Struggling to “Get” Math by 1024core on Friday October 14, 2022 @08:41PM (#33210439)
"The Internet" is much, much bigger than 500bn floats. The latest snapshot of archive.org has 505 billion web pages itself.
[ Parent | on HN ]