News for hackers. Stuff that matters.
Re:100x defect tolerance: How we solved the yield problem by versteegen on Thursday January 16, 2025 @06:02AM (#42723816)
Define "by definition".

Because this statement really makes no sense. Transformers are perfectly capable (and capable of perfectly) learning mathematical functions, given the necessary working-out space, e.g. for long division or for algebraic manipulation. And they can learn to generalise from their training data very well (although very data-inefficiently). That's their entire strength!

There are no comments on this comment yet.