News for hackers. Stuff that matters.
Re:Deep learning by anantzoid on Monday July 27, 2015 @12:05AM (#9953268)
So when you search randomly and reach up to a set of optimised parameters, how do you know if it can't be optimised any further, since you haven't looked up all possible sets like in a grid?
Re:Deep learning by shazeline on Monday July 27, 2015 @12:50AM (#9953403)
You generally don't know if you've reached a suitable maxima, which is why it is good to run a nondeterministic optimizer a few times (if computation power allows) and see if there are any reliable parameters form there.

There are also somewhat better-than-random strategies such as Bayesian optimization and particle swarm optimization that can help you to search more efficiently.

Re:Deep learning by DavidSJ on Monday July 27, 2015 @10:45AM (#9955460)
Grid search never exhausts the search space either, at least if the dimensions are continuous.