News for hackers. Stuff that matters.
Re:Rethinking the Computer Chip in the Age of AI by Animats on Sunday October 09, 2022 @02:37AM (#33138728)
Ah. Thanks.

"Three of the most important functions or operations are: 1) on-chip storage, 2) parallel search, and 3) matrix multiplication." All of which they claim to be able to do, more or less.*

Storage:

"...we also show that FeD devices can be programmed into 4-bit, distinct, conductive states with superior linearity and symmetry via electrical pulsing."

I think they mean they can distinguish at least 16 different analog levels, not that they are storing 4 discrete binary bits.

On-chip storage is a crossbar array of diodes whose state can be changed. It's a coincident-current addressing system, like old core memory. So you need 2N lines to address N^2 cells.

The two-terminal FeD devices show a diode- like self-rectifying behavior with ... endurance over 10^4 cycles,

Do they mean 10^4 cycles before it needs to be refreshed, like DRAM, or before it's worn out, like flash?

Search:

Search is more digital. Again, it's a crossbar thing, and all the rows are tested simultaneously.

Multiplication:

"This allows mapping the matrix multiplication operation, a key kernel in neural-network computation, into reading the accumulated currents at each bitline of a FeD device by encoding an input vector into analog voltage amplitudes and the matrix elements into conductances of an array of FeD devices."

Huh. That is an analog multiplier. Unclear how many bits of product you get. Probably 4. Do you get accurate results, after quantizing to 16 levels, or just ones that are reasonably close?

This is fascinating. It's a hybrid computer, something seldom seen in years. What can be done with this architecture is limited, but apparently well matched to what ML people want to do, which is very low precision multiply, add, and search.

Re:Rethinking the Computer Chip in the Age of AI by sizzle on Monday October 10, 2022 @02:36PM (#33154933)
Sounds like you should be working in this field?
Re:Rethinking the Computer Chip in the Age of AI by Animats on Monday October 10, 2022 @03:13PM (#33155328)
No, I'm not qualified. I'm just trying to figure out what the article really had to say.

Scientific PR articles are often deliberately hard to read, especially when some minor improvement is being inflated into a world-changing discovery. They have to be read with a viewpoint of finding what they're not telling you. This one is describing something that might be important. If they can fab the things and the noise level and lifetime are acceptable.

It's not clear that it gets the same result every time. Analog computers usually don't. But if the number of different levels is small enough, and the results are quantized to a small number of bits after the operation, maybe they can. That's much like the way modems with multiple signal levels work.

Or exact repeatability might not matter. People have proposed error-tolerant computing before. Devices can be smaller and lower power if the only have to be 99% right. It's enough of a headache that it never caught on. It's hell for debugging. But it might work for ML, which is somewhat noise tolerant.

Things could get strange if this catches on.