Gopher – A 280B parameter language model

Re:Gopher – A 280B parameter language model by gh0std3v on Thursday December 09, 2021 @12:34AM (#29494181)

While I want to believe this is true, I think the above response was more a lack of Gopher's ability to analyze mathematical equations properly than an attempt to display a sense of humour. Many NLP approaches work by creating word embeddings, which don't always help the model to understand "first-order logic" language mixed with spoken language.

Though who knows, maybe it does have a sense of humour.

[ Parent | on HN ]

Re:Gopher – A 280B parameter language model by muzani on Thursday December 09, 2021 @09:42PM (#29505866)

In full context, it's a conversation. "What does this mean, and what does that mean, what is also related to that?" If you ask a human impressively difficult questions then an absurdly trivial one, a human will probably respond with sarcasm. I'd expect Gopher to as well. It might get the answer right if you were asking it a series of arithmetic questions.

According to the link, Gopher is far better at math than GPT-3, and GPT-3 can solve "15 x 7", so I'd assume that Gopher would be able to as well.

[ Parent | on HN ]