News for hackers. Stuff that matters.
Re:Neurons that fire together, wire together, but how? by g_airborne on Monday June 29, 2020 @01:02PM (#23679428)
So this might be an enormous opportunity for low-cost and more performant AI if someone was able to build an FPGA of some sort that could handle these types of computations as efficiently right?
Re:Neurons that fire together, wire together, but how? by blamestross on Monday June 29, 2020 @02:00PM (#23680253)
Running the post-training network is a solved problem. (FPGA and ASIC can do it just fine). TRAINING the network is the difficulty. The problem is that the structure of the network is arbitrary and is a result of the learning process. You can't optimize a computation for a structure you don't know yet. Bipartite layer networks have the benefit of never changing structure but they can approximate other subset structures. I don't know if we could easily tell where we are on the tradeoff between "bipartite graphs are trained efficiently but are inefficiently simulating a smaller network in practice"