News for hackers. Stuff that matters.
Re:Being a Data Scientist: My Experience and Toolset by searine on Tuesday January 17, 2017 @03:49PM (#13421047)
>how many have actually gone through the work of deriving the functions they're calling to begin with?

Why would you waste your time re-inventing a wheel.

A good data scientist isn't good because he/she can ace shitty trivia, he/she is good because they know the right question to ask.

Re:Being a Data Scientist: My Experience and Toolset by achompas on Tuesday January 17, 2017 @04:56PM (#13421736)
That's only part of it. A good data scientist is also good because they know how to answer hard questions.

In those situations math isn't "shitty trivia," but instead a tool to be leveraged against those hard questions.

You can consider the derivation of SVD to be shitty trivia while throwing np.linalg.svd around while engineering features. That's fine! Good luck visualizing that data in a meaningful way, or dealing with non-linear data, if you're ignoring that "shitty trivia."

Re:Being a Data Scientist: My Experience and Toolset by marketforlemmas on Tuesday January 17, 2017 @09:09PM (#13423426)
> dealing with non-linear data

What is non-linear data?

Re:Being a Data Scientist: My Experience and Toolset by bigger_cheese on Tuesday January 17, 2017 @10:46PM (#13423800)
Data derived from non linear inputs.

That is to say problems that can't be expressed by linear functions.

I.e. Y= mx + B is a linear function.

Y= ax^2 + bx + C is a polynomial (non linear) function.

Linear Programming (LP) involves solving a series of linear equations (something like Excel's Solver can do this).

When you are dealing with non linear functions you need to use a method such as Sequential Quadratic Programming (SQP).

Re:Being a Data Scientist: My Experience and Toolset by q_revert on Thursday January 19, 2017 @04:54AM (#13434478)
Using a term like nonlinear science is like referring to the bulk of zoology as the study of non-elephant animals.

— Stanislaw Ulam

https://en.wikipedia.org/wiki/Nonlinear_system