News for hackers. Stuff that matters.
Re:Machine Learning 101: An Intro to Utilizing Decision Trees by nl on Friday September 30, 2016 @07:25AM (#12611803)
Features are variables which are inputs into your model.

Imagine you are predicting a basketball game. Features would be things like:

Season Win/Loss ration of each team

Number of wins in a row

Proportion of points by best player on team

etc etc.

These are pretty easy, but then sometimes you need to do work to generate the features - this is called feature engineering.

Some features which might need more "feature engineering":

Average sentiment of social network posting by team members

1-on-1 effectiveness of defensive players vs opposition offense (something like this might require video analysis and sometimes manual annotation)

In the computer vision world, things like edges and points are often used as features.

Deep learning is nice because it automatically learns these features given enough time. Otherwise people spend a lot of time building algorithms like SIFT etc.

Re:Machine Learning 101: An Intro to Utilizing Decision Trees by dejv on Friday September 30, 2016 @01:15PM (#12613752)
Good examples. Lets do another one, more text oriented.

Say you want to classify if text is spam or not. Features could be each word. Then you can build additional features on top of those words, like: - is header all caps? - is text contain some particular keyword (viagra, enlargement...) - are there typos? - link to weird domains?

and much more. You can create tons of those features. Some would be helpful, some neutral, some will decrease quality of your model.

Core of the machine learning is creating those features, sending them to algo and measuring impact. Choosing algo is actually smallest portion of your job (on most projects)

Re:Machine Learning 101: An Intro to Utilizing Decision Trees by nl on Friday September 30, 2016 @07:46PM (#12615890)
NGrams. Text processing almost always benefits from NGrams features.