Re:Using logistic regression to predict parking difficulty
by akhilcacharya on Friday February 03, 2017 @08:31PM
(#13565036)
For image classification, CNN's are still the way to go. But creating your own architecture and training your own novel model aren't necessary for most problems anymore it seems because of transfer learning.
[ Parent
| on HN ]
Re:Using logistic regression to predict parking difficulty
by markovbling on Saturday February 04, 2017 @12:23AM
(#13565770)
I threw all of the above plus CNNs at MNIST problem and boosted decision trees outperformed CNNs.
Granted if I tuned both perfectly, CNNs probably would have outperformed but with defaults and a small amount of parameter search, boosting worked best.
Re:Using logistic regression to predict parking difficulty
by akhilcacharya on Monday February 06, 2017 @11:27AM
(#13580990)
That's pretty interesting, why are boosted decision trees so effective? I've heard the same meme applied to kaggle competitions (everything is just a way to shove data into xgboost, etc)
Re:Using logistic regression to predict parking difficulty
by romaniv on Wednesday February 08, 2017 @01:13PM
(#13600549)
The grandparent post contains a hint of something I've already heard in lectures and from ML practicioners: boosting and random forests are more resilient to improper tuning (to put it another way, they are more universal and work well "out of the box").
Which, BTW, makes them more appealing to me personally. In many real-life cases extra few percent of accuracy matters very little, but ability to just apply something to a problem without much fuss matters a lot.