News for hackers. Stuff that matters.
Re:Leela Zero – Go engine with no human-provided knowledge by ForHackernews on Thursday November 16, 2017 @05:33AM (#15711588)
Could you design a cryptocurrency that used neural network training as part of a proof-of-work function? Then you'd actually get something useful at the end instead of brute-force hash collisions.
Re:Leela Zero – Go engine with no human-provided knowledge by zdkl on Thursday November 16, 2017 @05:39AM (#15711613)
You'd need to find some task that is expensive to compute, but trivial to verify to "port" current PoW methods, but the hard part is finding a task that fills this condition and is useful to actually compute.

In any case, you'd still be running a competition between nodes for fastest/best solution, with lots of duplicated effort and consumed resources. That is the key part of crypto consensus afaiu, and regardless of "backend task", there's always going to be waste in this architecture.

Re:Leela Zero – Go engine with no human-provided knowledge by yorwba on Thursday November 16, 2017 @05:53AM (#15711699)
The expensive task in machine learning is the training, it can be verified by checking for performance improvement on a validation set. You can make use of the duplicated effort if everyone trains on different examples, then their learned models can be merged/ensembled together for better performance.

That's the ideal situation when everyone plays by the rules. To make that scheme work as a "crypto"currency, you'll also have to make sure that breaking the rules doesn't bring a benefit. E.g. the validation examples can't be known beforehand, otherwise someone could just overfit to them to get a higher score with less work. But I think it might be possible to make it work.

Re:Leela Zero – Go engine with no human-provided knowledge by JustFinishedBSG on Thursday November 16, 2017 @11:30AM (#15713967)
> it can be verified by checking for performance improvement on a validation set.

Not all gradient updates improve performance

Re:Leela Zero – Go engine with no human-provided knowledge by yorwba on Thursday November 16, 2017 @10:20PM (#15718638)
Not all attempts to find a Bitcoin hash of the right difficulty succeed either. Miners would have to continue training until they are fairly certain that it has resulted in an improvement.
Re:Leela Zero – Go engine with no human-provided knowledge by bufferoverflow on Thursday November 16, 2017 @05:45AM (#15711643)
Which should be possible. For instance, your PoW could be "design a Go game bot neural network that's better than the system currently challenges you with".

Hard to make, easy to verify.

Re:Leela Zero – Go engine with no human-provided knowledge by vog on Thursday November 16, 2017 @05:57AM (#15711719)
> easy to verify

This may be a lot harder than you think.

How do you decide that one AI plays better than another? By playing lots of games. These games must be random, i.e. not known beforehand, otherwise the new AI could cheat.

But then, every cryptocurrency node would use a different set of game settings for validation. Which means that some (unlucky) nodes may reject the new AI while others accept it. The result are regular net splits, making it very hard to establish an keep the global consensus that is absolutely needed for a stable cryptocurrency system.

The core issue here is that validation must be 100% deterministic. Each node must run exactly the same calculations for validation, otherwise the consensus network is doomed.

Re:Leela Zero – Go engine with no human-provided knowledge by setr on Thursday November 16, 2017 @07:17PM (#15717938)
N seeds for the prng algorithm shipped with the program to be verified. Each seed provides for one game. N is sufficiently large to effectively remove "luck" for the skill comparison, and sufficiently large to make finding enough seeds allowing wins for a cheating weaker player more difficult than generating a better go player

Im assuming all games played against the incumbent; seeds are basically proof of wins. I guess you could still cheat though by copying the incumbent, get a 50-50 ratio of games, and then just find enough winners to make it 49-51.

Re:Leela Zero – Go engine with no human-provided knowledge by romaniv on Thursday November 16, 2017 @11:47AM (#15714146)
I think this is a very interesting idea. Except I would probably use a random forest instead of ANN for something like this. It is trivially parallelizable, you can train on subsets of features, you can slit and merge your ensembles/forests and so on.