News for hackers. Stuff that matters.
Re:Thermodynamic Linear Algebra (solving linear systems in O... by chenghuzi on Sunday August 13, 2023 @03:20AM (#37107478)
The RC circuit looks familiar. Is it related to neuromorphic computing hardware? Can it be implemented with existing hardware?
Re:Thermodynamic Linear Algebra (solving linear systems in O... by aifer4 on Sunday August 13, 2023 @03:27AM (#37107508)
An interesting feature of this approach is that the proposed hardware doesn't rely on non-linear elements, memristors, or even active elements (besides an optional noise source). It is simply a passive network of oscillators with a DC bias on each cell. That said, the hardware to implement this at scale does not currently seem to exist (yet?). To my knowledge, the state of the art is https://app.normalcomputing.ai/composer
Re:Thermodynamic Linear Algebra (solving linear systems in O... by chenghuzi on Sunday August 13, 2023 @03:50AM (#37107633)
From what I see, it's like mimicking the annealing process and the "derivative" automatically drives you to the solution. If that's the case, implementing such hardware should be not that hard except for the programmable coupling part. A bit off-topic, this reminds me of the duality between any deep forward network and a modern Hopfield network with some special energy functions, in which the duality is based on the fact that the forward running process can be seen as an energy minimization process.
Re:Thermodynamic Linear Algebra (solving linear systems in O... by aifer4 on Sunday August 13, 2023 @04:39AM (#37107888)
The relationship with Hopfield networks sounds fascinating, would love to discuss further. As you mentioned, there is a relationship to annealing in that we are encoding the solution to our problem in the minimization of a physical system's energy. Indeed, the all-to-all coupling is the hard part!
Re:Thermodynamic Linear Algebra (solving linear systems in O... by lachlan_gray on Monday August 14, 2023 @01:04PM (#37123506)
I haven't read the paper, so maybe completely irrelevant, but isn't there an analytical solution for a system of N coupled oscillators?