News for hackers. Stuff that matters.
Re:Differential Equations with Transformers: Deep Learning f... by whatshisface on Wednesday March 11, 2020 @11:09AM (#22546438)
On one hand you have 1980s symbolic AI that can produce true, coherent statements, and on the other you have GPT-2 which can produce really nifty gibberish. If you could put the two together maybe that would be some progress. I can see that getting transformers to emulate symbolic math might be a step in that direction.
Re:Differential Equations with Transformers: Deep Learning f... by throwlaplace on Wednesday March 11, 2020 @11:11AM (#22546458)
that's not reasoning though. it's not even an expert system or prolog (because adversarial examples exist). it's very close to a million monkeys typing.
Re:Differential Equations with Transformers: Deep Learning f... by monocasa on Wednesday March 11, 2020 @05:23PM (#22550858)
Where does a 100B neurons firing fit on to that spectrum?