News for hackers. Stuff that matters.
Re:'We can't compete': why universities are losing their bes... by olegkikin on Wednesday November 01, 2017 @08:46AM (#15600623)
So your argument is they should stay and work for pennies, hoping to get an "interesting" job in the future, instead of getting an interesting and highly paid job right now?

It's also not obvious at all it's a bubble. AI field is already much more complex than the regular CS field, which already suffers from talent shortages. AI is the future, and the demand is here to stay.

Re:'We can't compete': why universities are losing their bes... by sevensor on Wednesday November 01, 2017 @09:00AM (#15600727)
> It's also not obvious at all it's a bubble

It's breathtakingly obvious:

1. Large numbers of people getting poached from academic programs by industry.

2. "This time it's different" is what we've said during every bubble ever.

3. Lots of money chasing a few ideas.

The only thing that's not clear about this bubble is when it's going to pop. People who didn't see the potential of the internet in 1996 missed out. People who got into it in 2000 were left holding the bag.

Re:'We can't compete': why universities are losing their bes... by notyourday on Wednesday November 01, 2017 @09:11AM (#15600801)
I think you are missing the scale mentioned in the article:

The industry is paying five times what universities are paying. Not Fifty percent. Not double. Five times.

Professors/administrators whining about it are pure scum unless they themselves are making one fifth what they would be making in a different university that offered them a job purely because they love this specific college doing the specific research or teaching.

What is really pissing off these professors is that with their worker bees gone they themselves would need to do the work - something they are not quite used to.

Re:'We can't compete': why universities are losing their bes... by sevensor on Wednesday November 01, 2017 @09:35AM (#15600966)
> I think you are missing the scale mentioned in the article:

> The industry is paying five times what universities are paying. Not Fifty percent. Not double. Five times.

Nope, not missing that. You don't think this happened in 1999-2000?

I agree with you that grad students are ruthlessly exploited. I've seen that firsthand. I routinely discourage people from doing a Ph.D. for that reason. And if you're not too far along, taking a terminal master's and leaving for industry is a solid option, especially because this AI bubble won't last forever. But if, like the one student in TFA, you have just one year left, quitting grad school is not a great idea. Now you have, at best, an awkwardly long stretch of grad school on your CV with a master's degree on the end of it, and at worst, no degree at all to show for your pains. At that point, just suck it up and finish the degree.

Re:'We can't compete': why universities are losing their bes... by notyourday on Wednesday November 01, 2017 @02:20PM (#15604012)
> Nope, not missing that. You don't think this happened in 1999-2000?

I do. I'm yet to see people who jumped away from academic CS tracks at the time being upset about their decisions. I do know of dozens degreed people in their late thirties reporting to C students while making quarter of the salary of the same C students.

Re:'We can't compete': why universities are losing their bes... by YeGoblynQueenne on Wednesday November 01, 2017 @04:57PM (#15605409)
CS and AI are different subjects. As a CS dropout, your job is to write code. You can get quite competent at that without a higher education course.

You can't do that with AI. The amount of material you need to get on top of is really something else, especially if you want to be able to understand the foundations of what you're doing- which stretch back several decades before statistical machine learning, popular as it is today.

Re:'We can't compete': why universities are losing their bes... by notyourday on Wednesday November 01, 2017 @05:53PM (#15605835)
It is very naive to think that AI programs in most of universities is anything other than writing code and pretty lousy one.

Do you know that it was possible to get a PhD in genetic sequencing not a very long time ago from very serious schools? That's right, what today can be done by a random student or a random outsourcing shop in a third world country used to be a PhD worthy specialty.

In 5 years today's ML/AI PhDs would be in the same peculiar position as PhDs of genetic sequencing.

Re:'We can't compete': why universities are losing their bes... by YeGoblynQueenne on Wednesday November 01, 2017 @08:34PM (#15606833)
>> It is very naive to think that AI programs in most of universities is anything other than writing code and pretty lousy one.

Are you speaking from experience? Because my own experience from my degree and Master's AI courses and lectures is completely different to what you describe. Particularly during my Master's, code was only incidental; the meat and potatoes of each and every lecture was theory.

It depends of course on the quality of the teaching in a given institution, but, for instance, you can find here the lecture notes from Oxford's Deep NLP course:

https://github.com/oxford-cs-deepnlp-2017/lectures

As you will see, it's anything but just code, or lousy such. Of course, that's Oxford, their teaching is world-class- but most AI courses I've found on the internet are similar in scope.

Really, it's pointless trying to teach AI with "just code" - because in AI you can't really code much, unless you understand the theory.

>> In 5 years today's ML/AI PhDs would be in the same peculiar position as PhDs of genetic sequencing.

I think what you're saying is that in 5 years, people knowing Tensor Flow or Torch will be a dime a dozen.

Perhaps- but someone will still need to figure out some way to acquire new knowledge.

Also, it bears repeating that AI is not just statistical machine learning and statistical machine learning itself is not just deep learning. AI is a broad field with communities focused on many different subjects. Just as an example you can find information on, easily, try probabilistic programming.

Re:'We can't compete': why universities are losing their bes... by bobdole1234 on Wednesday November 01, 2017 @10:44PM (#15607437)
Back a decade or so ago, the only way to really reliably get access to current research was to work at a University or a large company with journal subscriptions.

These days it's really easy to get all the information you need to teach yourself whatever you need to. If you have problems, ask the Internet for help.

And these days, if you want to work on the actual leading edge, it's likely at Google, not at a University.

Re:'We can't compete': why universities are losing their bes... by YeGoblynQueenne on Thursday November 02, 2017 @05:45AM (#15608989)
>> These days it's really easy to get all the information you need to teach yourself whatever you need to. If you have problems, ask the Internet for help.

The information may be online but it's not organised in any way and if you're learning on your own, first you have to figure out what information is relevant to what you want to learn. University offers focus, support and guidance that you don't have when you're on your own.

I think a lot of developers treat machine learning as just another technology they can get good at if they apply themselves to it, like blockchain, non-relational databases, VR etc. In truth, AI is nothing like that. You really need to grok some background knowledge before you can do anything useful with it.

You can sure learn to use the free-access tools available today, like TensorFlow or Keras etc, but, for instance, you're not going to just figure out how to roll your own deep learning framework just by reading a few books you found online- like you could do for, say, a web framework. Nor does it mean that, just because you learned how to use a machine learnign framework, you can discover new knowledge and invent new machine learning algorithms, or optimise existing ones.

Which means- someone else always has to be there to do the hard work for you.

I'd say, that's the reason why it's AI PhD students who are being poached, and not just random devs who declare themselves "passionate about machine learning" on their facebook pages. Because the AI PhDs already have the background the big AI companies are looking for.

Re:'We can't compete': why universities are losing their bes... by YeGoblynQueenne on Wednesday November 01, 2017 @04:54PM (#15605388)
>> I agree with you that grad students are ruthlessly exploited.

More so than junior developers? In my experience, "junior programmer" means you'll do ten times the work for one tenth the salary - and everyone will treat you like an idiot on top of that (because, hey, if you were smart you wouldn't be a junior, amirite?).

I do think the exploitation of grad students is a US phenomenon, btw. And the article is about universities in the UK, where I'm pretty sure the conditions are different.

Re:'We can't compete': why universities are losing their bes... by notyourday on Wednesday November 01, 2017 @05:55PM (#15605854)
> More so than junior developers? In my experience, "junior programmer" means you'll do ten times the work for one tenth the salary - and everyone will treat you like an idiot on top of that (because, hey, if you were smart you wouldn't be a junior, amirite?).

Still pays more than a grad student.

Re:'We can't compete': why universities are losing their bes... by YeGoblynQueenne on Wednesday November 01, 2017 @08:37PM (#15606846)
I thought the point was about exploitation, not absolute monetary values?

Because if we're going for absolute money amounts, we might as well all give up on any sort of career in technology and shift our focus to getting some managerial position in a big corporation, somewhere- that's where the money's at.

Re:'We can't compete': why universities are losing their bes... by notyourday on Wednesday November 01, 2017 @09:28PM (#15607116)
It is about being exploited for extremely small amount of money. This is a real world. In real world, people need money. Shit is expensive. Food is expensive. Shelter is expensive. Everything is expensive.

Now it is possible that you are independently wealthy and it is irrelevant to you, but I can assure you anyone who is not independently wealthy would always trade shit job (A) which pays $K for a shit job (A) that pays $K + several thousand dollars, which is the complain of this article

Re:'We can't compete': why universities are losing their bes... by YeGoblynQueenne on Thursday November 02, 2017 @08:52AM (#15609917)
I'm not independently wealthy and I left a lucrative career in the industry to study what I am interested in, in academia, although neither my jobs in the industry were "shit jobs" nor is my current assignment.

So certainly not "anyone" would pick the best paying job, without any other consideration. Generally, people in academia are not in it for the money and their main motivator is not money- if it was, they would not be in academia.

I don't know where you get your ideas about academics from but I can tell they're not coming from experience with academics.

Also I'm not sure where you get your ideas about motivation. In my experience, the majority of people will choose work they find fullfiling over work that pays more but is not as interesting. Example: the typical developer prefers to be hands-on with code than become a manager, even if managers make more money than developers (in most companies).

Re:'We can't compete': why universities are losing their bes... by znpy on Wednesday November 01, 2017 @03:49PM (#15604849)
A PhD lasts five years in the us.

I would argue: what's the tangible difference between someone who has gone through all five years and someone who has gone through "just" four of them?

Plus, i don't think applied research is less important than base research.

Re:'We can't compete': why universities are losing their bes... by eli_gottlieb on Wednesday November 01, 2017 @09:59AM (#15601162)
>3. Lots of money chasing a few ideas.

That's the real problem. There are only so many fundamental things you can do with deep convnets as function inducers.

There's a lot of money to be made by applying those to a thousand different things, but even that has to taper off at some point.

Re:'We can't compete': why universities are losing their bes... by tMcGrath on Wednesday November 01, 2017 @12:15PM (#15602699)
I suppose it's limited by the size of 'the set of things you can do with functions'. This seems like a large enough set that I wouldn't be worried about hitting its limits too soon...
Re:'We can't compete': why universities are losing their bes... by eli_gottlieb on Wednesday November 01, 2017 @12:19PM (#15602747)
More like "the set of things you can do with functions, where you've got a strong prior on the functions being things like spacial mappings with certain invariances." So basically more like, "functions for vision problems."
Re:'We can't compete': why universities are losing their bes... by tMcGrath on Wednesday November 01, 2017 @12:32PM (#15602911)
You are absolutely right that a lot of work to date (especially in applications and metrics-driven research) has focused on 'functions for vision problems'. But this is far from the only idea - that's the point I'm trying to make.

For instance what about learning value functions for reinforcement learning (e.g. AlphaGo)? Or natural language processing? These are definitely not vision problems, or if you believe that they are then 'functions for vision problems' is actually a pretty huge class!

The universal approximation theorem backs up my claim [0] - we can approximate arbitrary functions with neural networks. I think this theorem is overemphasised in practice: we don't generally want to approximate arbitrary functions, we _want_ to encode specific prior information into the function we approximate, as you rightly say. But that doesn't mean that we have to do so, or that we only have one idea about what functions to encode, or even how to encode them.

[0] https://en.wikipedia.org/wiki/Universal_approximation_theore...

Re:'We can't compete': why universities are losing their bes... by eli_gottlieb on Wednesday November 01, 2017 @02:19PM (#15604006)
>The universal approximation theorem backs up my claim [0] - we can approximate arbitrary functions with neural networks. I think this theorem is overemphasised in practice: we don't generally want to approximate arbitrary functions, we _want_ to encode specific prior information into the function we approximate, as you rightly say. But that doesn't mean that we have to do so, or that we only have one idea about what functions to encode, or even how to encode them.

I wouldn't say we have only one idea about functions, but I would say I haven't seen much of an active pipeline, outside maybe DeepMind, on coming up with new kinds of priors over functions that we can apply to larger-scale or more structured tasks. At some point, applied deep learning will run out of steam, and someone's going to have to go back to doing basic research.

That someone may find, as many have, that in terms of sample efficiency and transfer learning, deep neural nets are not always so great.

Re:'We can't compete': why universities are losing their bes... by msla on Wednesday November 01, 2017 @11:40AM (#15602287)
> Large numbers of people getting poached from academic programs by industry.

You say this like someone who thinks academia deserves those people and industry is "stealing" them.

Re:'We can't compete': why universities are losing their bes... by nopinsight on Wednesday November 01, 2017 @11:43AM (#15602316)
The market for autonomous vehicles (land, air, water) alone could become larger than the entire IT industry in 2000.

When you include robots for industry (e.g. Sewbots, Warehouse robots, ...) and household (e.g. Aibo, Amazon Echo, ...) it is clear that the markets are potentially much larger than their current sizes and will grow with improvements in AI.

Recent papers in AI and Deep Learning have shown that it is possible to train robots to adapt to unpredictable environment and human interactions. This will realize many new potential applications in the physical space over the next decade.

Although the fundamentals are the same, the variations are legion and could become highly complex as the environment dictates. It takes a few years at least to become an expert in the field with experience in practical applications. Not everyone possesses a cognitive toolkit necessary to become one either. There will not be an oversupply of experts in AI and ML within the next five or even ten years.

Re:'We can't compete': why universities are losing their bes... by yequalsx on Wednesday November 01, 2017 @09:27AM (#15600909)
It may appear obvious to you but you don’t really know that there is a current AI bubble. There’s an economics adage that seems apt:

Economists have predicted 15 of the last 10 recessions.

Re:'We can't compete': why universities are losing their bes... by bobdole1234 on Wednesday November 01, 2017 @10:38PM (#15607412)
Investors were left holding the bag.

The rest of us just kept working and earning.

Re:'We can't compete': why universities are losing their bes... by Retric on Wednesday November 01, 2017 @08:50AM (#15600654)
AI is currently less complex than many CS fields that pay far less.

This is basicly the boom times when most companies want a website but don't have one. Once the obvious applications are built these bubbles tend to burst as matence pays far less.

Re:'We can't compete': why universities are losing their bes... by nopinsight on Wednesday November 01, 2017 @11:23AM (#15602065)
Plain vanilla convnets are not very complex. If you look at recent papers on Deep Reinforcement Learning with extra modules or Generative Adversarial Networks from DeepMind and the likes, the complexity is much higher than much of CS used in industry and it is increasing rapidly.

More importantly, the performance of many AI implementations could be improved with the increased sophistication, so the demand for such complexity is there for businesses in competitive sectors.

Any examples of topics in other fields of CS in practical use that are more complex than recent AI advances with potential practical applications?

Re:'We can't compete': why universities are losing their bes... by Retric on Wednesday November 01, 2017 @11:38AM (#15602258)
I would argue a modern Graphics pipeline is significantly more complex. But, you run into issues of what the borders of a topic is. Lighting for example is a huge topic for research, but it does not mean much on it's own.
Re:'We can't compete': why universities are losing their bes... by wolfgke on Wednesday November 01, 2017 @08:54AM (#15600684)
If universities believe that AI is here to stay, offer tenured positions now to your AI scientists. Universities cannot compete on pay (and I don't think this is bad), but they can compete perfectly well on job security. So play this trump card (no pun intended).
Re:'We can't compete': why universities are losing their bes... by taway_1212 on Wednesday November 01, 2017 @04:06PM (#15604980)
We’ve had AI winters before, who knows if the next one isn’t coming.