News for hackers. Stuff that matters.
Re: Researchers unveil a pruning algorithm to shrink deep le... by jb775 on Friday May 08, 2020 @11:50PM (#23122134)
> The catch is that this sparse subset of NN edge weights has no structure, so it doesn't get efficient execution on a GPU

Could you elaborate a little on this aspect?

Re: Researchers unveil a pruning algorithm to shrink deep le... by jointpdf on Saturday May 09, 2020 @12:34PM (#23126128)
I could be off-base here, but I think they’re saying that a sparse matrix (for holding the edge weights) is ultimately something like a list-of-lists format, rather than a dense n x m array (for which GPUs have optimized routines). Except I that there are libraries doing sparse matrix operations on GPU (https://developer.nvidia.com/cusparse).