News for hackers. Stuff that matters.
Re:Transformers Can Do Arithmetic with the Right Embeddings by sshine on Tuesday May 28, 2024 @08:37AM (#40500119)
> an emergent phenomenon from having enough connections in a graph, or ... some other special sauce

For humans, it is emergent. But when we reason about reason, we invent special sauce.

If we build our theories of reason into our models, they achieve the strengths and limitations of our models.

If we don't, we're limited by the pace of evolution, because we don't have enough connections in our graph.

So I think we'll have something immediately more useful if we embed ALU special instructions into a neural network.

There are no comments on this comment yet.