News for hackers. Stuff that matters.
Re:Nvidia Unveils Blackwell, Its Next GPU by AYBABTME on Wednesday March 20, 2024 @10:20AM (#39766962)
Matrix multiplication is just an effective representation for the dense graph structures. The same graphs could be implemented in other ways (adjacency list, edge list), perform the same overall logic, without doing vector/matrix/tensor math. It seems like the magic is in the overall idea of neurons and networks of them following increasingly interesting architectures and training mechanisms.

But because these graphs are mostly dense and involve numerical operations, matrices/tensors are a great implementation.

There are no comments on this comment yet.