News for hackers. Stuff that matters.
Re: Researchers unveil a pruning algorithm to shrink deep le... by visarga on Saturday May 09, 2020 @12:08AM (#23122232)
Using a sparse adjacency matrix in combination with regular matrix operations solves the problem of fitting any graph topology into matrices (used in graph neural nets). You can put multiple graphs together in the same adjacency matrix and batch them up for efficient computation.
Re: Researchers unveil a pruning algorithm to shrink deep le... by cs702 on Saturday May 09, 2020 @01:32PM (#23126628)
You would think so, but the problem is more complex than it appears to be: https://dl.acm.org/doi/pdf/10.1145/3317550.3321441?download=...

There's a big "impedance mismatch" between (1) "programmability" (by which I mean, being able to write high-level code that under-the-hood requires dynamic modification, reshaping, and/or combination-optimization of those adjacency matrices you mention, without worrying about performance) and (2) existing infrastructure (frameworks that rely on highly optimized computation "kernels" that cleverly exploit the memory layout and other features of accelerated hardware, i.e., GPUs/TPUs).