News for hackers. Stuff that matters.
Re:The Era of 1-bit LLMs: ternary parameters for cost-effect... by WiSaGaN on Thursday February 29, 2024 @10:03AM (#39550227)
Could the reason that 3 states in this case be more efficient than 2 states be that 3 is closer to 2.718... (Euler's number) than 2 is?
Re:The Era of 1-bit LLMs: ternary parameters for cost-effect... by altruios on Thursday February 29, 2024 @10:30AM (#39550658)
Why not have some layers/nodes/systems be 2 states and have others be 3... couldn't you get arbitrarily close to Euler's number that way?