News for hackers. Stuff that matters.
Re:Data Science Teams Need Generalists, Not Specialists by dagw on Thursday March 21, 2019 @06:02AM (#19450524)
They need both. Having a domain expert in the domain you are modelling will save you a lot time and lets you avoid a lot of dumb mistakes.
Re:Data Science Teams Need Generalists, Not Specialists by 0815test on Friday March 22, 2019 @07:32AM (#19461520)
Also, you need domain expertise to do good feature engineering and to develop good tailored architectures. These are quite critical to obtaining SOTA results, so far as I can tell. People like to pretend that deep learning and "AI" have made feature/model engineering unnecessary, and it's just not true.
Re:Data Science Teams Need Generalists, Not Specialists by hikkigaya on Friday March 22, 2019 @08:31AM (#19461882)
Not really, you don't need to be an expert in go to beat the best go player.
Re:Data Science Teams Need Generalists, Not Specialists by bloomer on Friday March 22, 2019 @09:10AM (#19462161)
Except go (and all other well defined games) are the most trivial of domains. For real business problems, the difficulty is most often trying to determine what the problem is and how it relates to the rest of the world.
Re:Data Science Teams Need Generalists, Not Specialists by currymj on Friday March 22, 2019 @09:32AM (#19462333)
there was a strong model of the world in AlphaGo, which allowed it to accurately simulate games that followed the rules.

that is quite a lot of domain expertise, much more than in most ML systems.

Re:Data Science Teams Need Generalists, Not Specialists by natalyarostova on Friday March 22, 2019 @12:16PM (#19464010)
Another way of saying this, is you don't really need the same level of domain expertise if the problem space is entirely defined by a small set of clearly articulated rules.
Re:Data Science Teams Need Generalists, Not Specialists by nerdponx on Friday March 22, 2019 @09:02AM (#19462113)
I'd be very surprised if the AlphaGo team didn't at least consult with a few Go players...
Re:Data Science Teams Need Generalists, Not Specialists by 4thaccount on Thursday March 21, 2019 @06:40AM (#19450752)
Yea. In my industry you could hire a team of generalists and I wouldn't expect any of their conclusions to be valid. Now if a domain expert can get them a valid dataset...then they can do some statistics and analysis and maybe uncover something I wouldn't notice.