News for hackers. Stuff that matters.

A comment on The Era of 1-bit LLMs: ternary parameters for cost-effective computing. Parent comment

Re:The Era of 1-bit LLMs: ternary parameters for cost-effect... by rafaelero on Wednesday February 28, 2024 @08:55AM (#39537930)
It's more likely that Nvidia will offer support to INT2 in the next generation and keep their dominance.
[ Parent | on HN ]
Re:The Era of 1-bit LLMs: ternary parameters for cost-effect... by Klipper3 on Wednesday February 28, 2024 @05:19PM (#39544211)
INT2 ternary is equivalent to INT1 + binary mask. Nvidia supprted INT1 matrix multiply in RTX20 and RTX30 generations, nobody used it, so they removed INT1 support from RTX40 generation.
[ Parent | on HN ]
Re:The Era of 1-bit LLMs: ternary parameters for cost-effect... by ByThyGrace on Thursday February 29, 2024 @08:23AM (#39548963)
What I get from your comment is now older RTX gens are going to be in high demand soon.
[ Parent | on HN ]
Re:The Era of 1-bit LLMs: ternary parameters for cost-effect... by ActionHank on Thursday February 29, 2024 @06:58AM (#39548259)
"next generation" those two words mean a whole lot.

Intel and AMD could also implement support in their "next generation" and that would be huge.

[ Parent | on HN ]