News for hackers. Stuff that matters.

A comment on Executing programs inside transformers with exponentially faster inference.

Re:Executing programs inside transformers with exponentially... by ndxone on Friday March 13, 2026 @04:58AM (#47362073)
big question is how efficient is this compare to executing assembly on CPU
[ Parent | on HN ]
Re:Executing programs inside transformers with exponentially... by WithinReason on Friday March 13, 2026 @10:55AM (#47365333)
My guess would be in the ballpark of about 10000 times less efficient
[ Parent | on HN ]