Machine Learning Trick of the Day: Instrumental Thinking

Posted by ghosthamlet on Thursday December 13, 2018 @06:04AM
from the blog.shakirm.com dept.

http://blog.shakirm.com/2018/10/machine-learning-trick-of-the-day-8-instrumental-thinking/

( 10 comments | 125 points | on HN )

Re:Machine Learning Trick of the Day: Instrumental Thinking by alexcnwy on Thursday December 13, 2018 @04:23PM (#18676266)

Shakir is a force of nature. He is one of the organizers of the Deep Learning Indaba - an incredible effort to strengthen machine learning in Africa. Unfortunately the 2018 videos aren't out yet (Shakir gave an amazing talk on deep learning fundamentals and some of the tricks from his blog) but everyone should be aware of Shakir and the Deep Learning Indaba: http://www.deeplearningindaba.com/

[ Parent | on HN ]

Re:Machine Learning Trick of the Day: Instrumental Thinking by bonoboTP on Thursday December 13, 2018 @11:27PM (#18678475)

Seems related to noisy-input Gaussian Process [1] that I applied in my thesis with moderate success some years ago.

[1] http://mlg.eng.cam.ac.uk/pub/pdf/MchRas11.pdf

[ Parent | on HN ]

Re:Machine Learning Trick of the Day: Instrumental Thinking by vervez on Thursday December 13, 2018 @06:43PM (#18677185)

Excellent post about potential flaws of your typical linear regression model and how to address with causal methods. As a self-taught practitioner, these posts are priceless in letting me know what I don't know...

[ Parent | on HN ]

Re:Machine Learning Trick of the Day: Instrumental Thinking by remarkEon on Thursday December 13, 2018 @09:09PM (#18677849)

Does the machine learning field have different nomenclature for this sort of thing than, say, econometrics?

I recognize all the math, but the verbiage used is different.

[ Parent | on HN ]

Re:Machine Learning Trick of the Day: Instrumental Thinking by pjmorris on Friday December 14, 2018 @11:55AM (#18682269)

Each field seems to have its own nomenclature. I recognize 'instrumental variables' from a (bio-)statistics course, so I think that's a pure statistics term. Larry Wasserman has a vocabulary chart in 'All of Statistics' (there's a PDF I won't link to) that lists terms differing between statistics and computer science. For example he writes that 'using data to estimate an unknown quantity' is called 'estimation' in statistics and 'learning' in computer science.

[ Parent | on HN ]

Re:Machine Learning Trick of the Day: Instrumental Thinking by jriot on Thursday December 13, 2018 @09:34PM (#18677989)

I'm a trained a econometrician and a data scientist. Have you found people to be apprehensive with you since 'our' verbiage is different?

[ Parent | on HN ]

Re:Machine Learning Trick of the Day: Instrumental Thinking by remarkEon on Friday December 14, 2018 @03:07AM (#18679266)

Is that what I asked?

I'm asking about why the usage of the mathematics that you and I are apparently both familiar with could be described in different ways depending on which field is referencing it. This is a linguistic question - not a mathematical one.

No need to be rude.

[ Parent | on HN ]

Re:Machine Learning Trick of the Day: Instrumental Thinking by yorwba on Friday December 14, 2018 @03:15AM (#18679303)

Is that what they asked?

Nomenclature is different in different fields all the time, or even different areas of the same field. It all depends on what practitioners feel is most intuitive.

No need to call someone rude for not answering your question and asking their own instead.

[ Parent | on HN ]

Re:Machine Learning Trick of the Day: Instrumental Thinking by jriot on Friday December 14, 2018 @01:15PM (#18683040)

What was rude? A question?

[ Parent | on HN ]

Re:Machine Learning Trick of the Day: Instrumental Thinking by maurits on Friday December 14, 2018 @04:18AM (#18679543)

Shakir is a fantastic technical writer. I love that he also traces modern ideas back to their older roots and includes the references.

[ Parent | on HN ]