News for hackers. Stuff that matters.
Re:Ask HN: Is anybody building an alternative transformer? by RossBencina on Friday February 14, 2025 @09:46PM (#43055416)
One claim from that podcast was that the xLSTM attention mechanism is (in practical implementation) more efficient than (transformer) flash attention, and therefore promises to significantly reduces the time/cost of test-time compute.
Re:Ask HN: Is anybody building an alternative transformer? by korbip on Friday February 14, 2025 @10:14PM (#43055573)