News for hackers. Stuff that matters.
Re:The AI Research SuperCluster by kn8a on Monday January 24, 2022 @11:44PM (#30068114)
Could something like 'lottery ticket' review approach make this process faster? I might be wrong but I am not sure if that is parallelized.
Re:The AI Research SuperCluster by randcraw on Tuesday January 25, 2022 @10:35AM (#30072935)
I'm not sure what you mean by 'lottery ticket' review -- presumably some sort of random global search shortcut, like mutation in genetic algorithms.

If so, then no, using randomness to disrupt search only resets the search to continue at a different (random) spot in the global search space. That kind of approach certainly can escape local minima, but it doesn't diminish the amount of total time/effort required to do (non-convex) global search.

I think the long history of our attempting to use randomness to improve search has shown that all naive approaches inevitably fail unless the number of processors available can be scaled up to 'equal' the number of decisions required to explore the entire search space (as quantum computing seeks to do). But maybe the formal resolution of that question will come only after we prove P != NP.

Re:The AI Research SuperCluster by kn8a on Tuesday January 25, 2022 @05:05PM (#30078770)
Sorry I meant the 'lottery ticket' hypothesis. https://arxiv.org/abs/1803.03635v1

The lottery tickets are random but they are basically - as I understand - smaller graphs that have the same strength as a larger graph.