News for hackers. Stuff that matters.
Re:Google Titans architecture, helping AI have long-term memory by moffkalast on Sunday December 07, 2025 @05:18PM (#46185805)
Are there any pretrained models with this architecture yet or is it all still completely theoretical beyond Google's unverifiable claims? They published the original Titans paper last year and nobody seems to have built on the idea.
Re:Google Titans architecture, helping AI have long-term memory by djrhails on Sunday December 07, 2025 @07:46PM (#46187050)
https://github.com/lucidrains/titans-pytorch - is the only public iteration.

But no one appears to have taken the risk/time to properly validate it.

Re:Google Titans architecture, helping AI have long-term memory by AlexCoventry on Sunday December 07, 2025 @09:11PM (#46187535)
The fundamental ideas in the paper aren't particularly novel. They will probably work as advertised.