News for hackers. Stuff that matters.
Re:Hardware Acceleration of LLMs: A comprehensive survey and... by chatmasta on Saturday September 07, 2024 @12:34PM (#41474794)
I'm a layman on this topic, so I'm definitely about to say something wrong. But I recall an intriguing idea about a sort of "reversion to analog," whereby we use the full range of voltage crossing a resistor. Instead of cutting it in half to produce binary (high voltage is 1, low voltage is 0), we could treat the voltage as a scalar weight within a network of resistors.

Has anyone else heard of this idea or have any insight on it?

Re:Hardware Acceleration of LLMs: A comprehensive survey and... by gugagore on Saturday September 07, 2024 @02:25PM (#41475481)
The question then emerges: how do we program these things?

Sara Acour has some answers, e.g. https://scholar.google.com/citations?view_op=view_citation&h...