Fast KV Compaction via Attention Matching

Re:Fast KV Compaction via Attention Matching by WarmWash on Friday February 20, 2026 @09:46AM (#47088667)

Considering the insanity of the AI arms race going on now, and the incredible sums of money be thrown at any slight advantage, is there any reason to believe that any meaningful AI breakthrough would be openly published for anyone to leverage?

[ Parent | on HN ]

Re:Fast KV Compaction via Attention Matching by 542458 on Friday February 20, 2026 @10:12AM (#47088996)

These folks are MIT, so citations are valuable to them. Citations convert into prestige, academic career progression, or a favorable exit from academia into industry.

Also, I don't see why you couldn't patent this if you wanted to monetize it.

[ Parent | on HN ]

Re:Fast KV Compaction via Attention Matching by BetaDeltaAlpha on Friday February 20, 2026 @12:55PM (#47091368)

> Also, I don't see why you couldn't patent this if you wanted to monetize it.

We all just saw the prior art published for the public. That will preclude patenting this work. Further reduction to practice is required.

(I am not a lawyer).

[ Parent | on HN ]

Re:Fast KV Compaction via Attention Matching by mikodin on Friday February 20, 2026 @09:57AM (#47088797)

I would say yes.

The reality is that the money being thrown = the time of humans. I guess compute as well, but in terms of people doing innovation - openly published things are the same thing, minus the money.

[ Parent | on HN ]

Re:Fast KV Compaction via Attention Matching by abeppu on Friday February 20, 2026 @10:06AM (#47088904)

I do sometimes wonder -- if the transformers paper wasn't published, what would the industry be like? Would the same ideas have been put together in almost the same way weeks or months later somewhere else?

[ Parent | on HN ]

Re:Fast KV Compaction via Attention Matching by cma on Friday February 20, 2026 @11:08AM (#47089833)

The inventor's grace period under first to file changes still gives them/their university a year to file if they publish openly.

[ Parent | on HN ]

Re:Fast KV Compaction via Attention Matching by gdiamos on Friday February 20, 2026 @12:55PM (#47091377)

I know the frontier “labs” are holding back publications.

I don’t think it will last among researchers who think beyond production LLMs

[ Parent | on HN ]

Re:Fast KV Compaction via Attention Matching by jph00 on Friday February 20, 2026 @01:26PM (#47091770)

Yes there is. Lots of researchers are more interested in making a contribution to societal flourishing than in making incredible sums of money. That’s why there’s still lots of top AI researchers in academia.

[ Parent | on HN ]