News for hackers. Stuff that matters.

A comment on The "it" in AI models is the dataset. Parent comment

Re:The "it" in AI models is the dataset by HarHarVeryFunny on Thursday April 25, 2024 @10:48AM (#40158244)
If Mamba really was as capable as a Transformer on tasks requiring accurate attending to long context, then there'd be no need for Jamba (Mamba+Transformer hybrid).

Your argument of "if we train a Mamba SSM to be as good as a Transformer, then it'll be as good as a Transformer", seems a tad circular...

[ Parent | on HN ]

There are no comments on this comment yet.