News for hackers. Stuff that matters.
Re:Lets Use ML for Insights by pedalpete on Monday March 23, 2020 @07:08PM (#22669831)
I had assumed that this was a solved problem, am I wrong? Isn't this what quants are doing with the markets? Watching x number of inputs to predict the probability of y output?

Can somebody clarify what I'm missing? I'd love to find out more about this area of ML, is there a name for it?

Re:Lets Use ML for Insights by unishark on Monday March 23, 2020 @09:20PM (#22670826)
Well there's the field of "statistics".

"Data Science" seems to just generally include everything that starts with data and ends with new information.

Back when it was called "Data Mining", there was a particular aspect called "Knowledge Discovery". KDD = knowledge discovery from databases, which one of the biggest ML conferences is named after.

Re:Lets Use ML for Insights by jw887c on Monday March 23, 2020 @07:55PM (#22670247)
I view it as:

Explainable models = statistical models (regression / multilevel models).

Black box models = machine learning (tree based models).

AI = black box models for computer vision / NLP.

Re:Lets Use ML for Insights by mistrial9 on Monday March 23, 2020 @08:23PM (#22670449)
hmm Black box models - refers to NeuralNets that build iteratively "unsupervised" .. confusion reading this because, tree-based models sounds similar to other, non-NN models such as RandomForest.. a RandomForest model is reproducible and may be very explainable, depending on the way the setup was done "and other factors"

AI = long history of multiple meanings of this term, but a common one is "get computers to solve a question that used to be only solveable by a human".. not at all specific to vision 'slash' natural language processing

Re:Lets Use ML for Insights by mnky9800n on Tuesday March 24, 2020 @05:36AM (#22673300)
I don't know why trees are black box when partial dependence has existed for 20 years.
Re:Lets Use ML for Insights by scribu on Monday March 23, 2020 @07:27PM (#22670011)
The general activity is called Exploratory Data Analysis (EDA).

Not sure if there's another name for "EDA using ML".