News for hackers. Stuff that matters.

A comment on The Era of 1-bit LLMs: ternary parameters for cost-effective computing. Parent comment

Re:The Era of 1-bit LLMs: ternary parameters for cost-effect... by Klipper3 on Wednesday February 28, 2024 @05:19PM (#39544211)
INT2 ternary is equivalent to INT1 + binary mask. Nvidia supprted INT1 matrix multiply in RTX20 and RTX30 generations, nobody used it, so they removed INT1 support from RTX40 generation.
[ Parent | on HN ]
Re:The Era of 1-bit LLMs: ternary parameters for cost-effect... by ByThyGrace on Thursday February 29, 2024 @08:23AM (#39548963)
What I get from your comment is now older RTX gens are going to be in high demand soon.
[ Parent | on HN ]