News for hackers. Stuff that matters.
Re:Mamba Explained: The State Space Model Taking On Transfor... by pixl97 on Sunday February 25, 2024 @02:49PM (#39504121)
This still makes little sense as that scale will always matter. If you can drop the compute cost of a model by 10x it means you can increase model integrity/intelligence/speed etc beyond what your compute bound competitors have.

Simply put, for the time being huge datasets are going to be needed and those with bigger (cleaner?) datasets will have a better behaving model.

There are no comments on this comment yet.