News for hackers. Stuff that matters.

A comment on The Era of 1-bit LLMs: ternary parameters for cost-effective computing. Parent comment

Re:The Era of 1-bit LLMs: ternary parameters for cost-effect... by loudmax on Wednesday February 28, 2024 @08:08AM (#39537356)
The Veritasium Youtube channel did a video about this about a year ago: https://www.youtube.com/watch?v=GVsUOuSjvcg

They visit Texas company Mythic AI to discuss how they use flash memory for machine learning. There's a California company named Syntiant doing something similar.

[ Parent | on HN ]
Re:The Era of 1-bit LLMs: ternary parameters for cost-effect... by dwightboyyy on Wednesday February 28, 2024 @09:06PM (#39545807)
I was thinking of this exact video, crazy to think that the principle is gaining momentum
[ Parent | on HN ]