News for hackers. Stuff that matters.
Re:Academia Is Eating Its Young by michaelochurch on Saturday March 23, 2013 @06:53PM (#5430138)
I've been doing a lot of analysis of organizational decline over the past month, and what characterizes R&D (including academia) is extreme convexity: http://michaelochurch.wordpress.com/2013/03/14/gervais-macle...

Convexity pertains to the shape of the curve for output (profits, value added, impact) per input (investment, skill, effort, and just plain luck). It pertains to desirable risk behavior (convex => seek risk; concave => limit it). Most of the "fun" work (arts, sciences) is convex. It's creative and difficult and you usually don't get directly paid, but when you have a hit, it's Big. The problem with convex work is that everyday people can't handle that kind of income variability. Institutions can, and if they're working properly, they buy that risk.

Some areas of work are so convex that only altruistic financing (public or academic funding without repayment expectations, long-term implicit autonomy) are tenable. Science and most of what academia does will return value to society, with interest, but the convexity puts such a time gap between the creation and capture of value that an institution required to capture value generated (e.g. a for-profit corporation) wouldn't survive at it. You need implicit trust and autonomy for that.

I like the idea of academia and like the idea of saving it, but it'll be hard to do. The system is now generationally broken and it will take heroic efforts to heal it.

When you start studying institutional decline as I have, you learn a few things. First, institutions are all about moving risk-- finance, in other words, although sometimes of a more abstract kind than what happens on Wall Street. There's nothing wrong with that. Risk transfers are great. The professor gets stable financial mediocrity (which most people would accept, even me; I've met the $2M/year Wall Street crowd and they're just as unhappy as anyone else) while doing exciting work, and doesn't have to worry about capturing the value. However, the second thing you learn is that the MacLeod cartoon (Losers, Clueless, Sociopaths) is the truth (a Loser/Sociopath risk trade) and The Bad Guys really do exist. They turn what were once fair risk transfers into "heads, I win; tails, you lose" affairs. That's what academia is, these days. Professors no longer get the autonomy (freedom from market risk) they were promised until their most productive years (due to the unsustainable nature of what it takes to get tenure, and midlife burnout) are behind them. Instead, post-1980 they have a great deal more career risk than they should have, given the obvious convex value of what they (as a group) achieve. They work really hard for many years for someone else's benefit, and most get tossed aside at the end of it. Heads, I win. Tails, you lose.

Obviously, the "trickle-down economics" 1980s were horrible and started this looting and tearing down. The demolition of the academic job market started then and hasn't stopped. However, looking into it objectively, there is one thing that professors did that ruined their game (for most of them). They began, as a culture, to devalue teaching.

It's not the fault of the people who are 28 now and trying to get professorships. They weren't even alive when it started. But the Baby Boomers created an academic culture in which research (often esoteric or inaccessible to outsiders) was "the real work" and teaching was just commodity grunt work, to be tossed aside to $15/hour TAs and otherwise scaled back (200+ student classes). This "teaching is a commodity" attitude led to a greater society (unable to see the value of research) hitting back with, "then why the fuck are we paying so many of you?" Now academia is dying. When you have uneducated, right-wing idiot state senators who didn't get feel like their professors gave a shit, they repay the favor in 20 years by cutting funding for 20 years.

The moral lesson (and it applies to us as programmers, too) is that teaching (for us, documentation and outreach) isn't commodity grunt work. It's vital. It's often where most of the value is added. If you blow teaching off, the world will lose interest in you and pull investment. I would say "you deserve it" but, in the academic sphere, it's a different (younger) set of people getting whacked for it.

Sadly, that karma was slow to act on academia. It was Baby Boomer careerist narcissists who copped that "fuck teaching" attitude, and Gen-X/Millennials who got the shaft... like so much else in society.

Re:Academia Is Eating Its Young by bokonist on Saturday March 23, 2013 @08:27PM (#5430475)
Hmm, I think the problem is slightly different.

The job of a tenured professor in 1980 was pretty sweet. Upper middle class salary, great job security, a soap box from which to influence impressionable minds, freedom to pursue intellectual interests, etc. Naturally, as with any career track that looks pretty sweet, people rush to enter the field. Thus the great numbers of grad students.

There are basically three ways a guild profession can react to an influx of new demand: a) lower the salary and benefits of the master guildsmen to make the profession less desirable and to allow more overall hiring, until supply and demand balance out. b) make the entrance requirements more and more onerous in order to restrict entry c) use a lottery system.

Option a) is out of the question because it hurts the powerful senior professors who run the existing system.

Option b) is the path the universities took. Earning tenture requires more years in grad school, more years as a junior professor, and more risk of never reaching the goal. And the actual research requires mastering extremely esoteric readings and/or mathematical techniques that have virtually no use for actually doing productive research. But requiring mastery of these techniques simply became the default filter. When you have too many grad students, the default is to make the tests harder until you have sufficiently reduced the number who can pass. They then become the new professors, and thus have an inordinate love and respect for the esoteric test material that allowed them to get their current job. The result is the death spiral you describe - burnt out professors who are out of touch with reality.

Option c) a lottery, is the route academia probably should have taken. Set some sort of bar for admittance into grad school - great GRE's, great grades, and great recommendations, and then simply lottery off the spots. Keep the spots few enough so that there is a clear path to a tenured professorship.

But the real underlying problem is that academia is not accountable. Academia is suffering from the problems that plague any self-selected priesthood - over time its practices grow more esoteric and out of touch with reality. There are a few good departments out there, but most departments neither do good teaching nor good research.

Unfortunately, the body that has the lawful right to regulate academy (Congress and State legislatures) are too dumb and too fickle to do the job well. What "reform" happens takes the form of temper tantrums that do little to fix the system.

In the end, I think fixing academia is thus a "regime change complete" problem - ie. not possible in the American political system as it currently exists.

Re:Academia Is Eating Its Young by simonster on Saturday March 23, 2013 @09:40PM (#5430692)
I think that, in a sense, a) would have been the right solution here.

While I'm not sure this is the case in all fields, at least in mine, when you apply for grants, people too much about how famous you already are and what you have published. People don't care about how many grants you already have, or how much money you burned through to produce your previous publications.

This is bad.

First, it creates the illusion that there are more scientists out there than can be sustained by grant funding, when in reality the problem isn't lack of funding, but the fact that the funding gets concentrated in the hands of the highly successful instead of being evenly distributed to the highly and moderately successful. Thus, pursuing a career in science becomes risky because you might not be able to get a job (as GP stated), and so people decide they don't want to do science.

Second, it's inefficient. A professor at my institution employs 50 people and produces about 1 paper per year. 15 moderately successful professors with 2 people working under each of them could do much better than that. But he has a Nobel prize and they don't.

Finally, it's horrible for the people in these labs. This is where accountability comes in. A professor with a small lab is accountable for the success of each of his students/postdocs. With larger labs, professors can allow students to fail, because their success is no longer necessary for success of the labs. Moreover, professors run out of ideas and waste their trainees' time. (I have heard rumors that a different Nobel prize winning scientist hired multiple people to work on the same project, not as collaborators, but as competitors. The person who won got a high-impact publication. The person who lost got nothing.)

There's no obvious solution here, since science can't be funded completely algorithmically, but to start I think that funding agencies should be requiring professors to disclose both the number of personnel they employ and their grant history when they apply for further grants, and take this into account during the review process.

Re:Academia Is Eating Its Young by vwinsyee on Sunday March 24, 2013 @01:36AM (#5431266)
A quick comment about point 2: A lot of academia is about quantity over quality these days. One high-impact, well-designed paper with strong conclusions could very well be worth more than 50 weaker papers. Unfortunately these days, many people, especially those outside of the field, may perceive the 50 weaker-paper lab(s) to be more "efficient" than the 1 strong-paper lab.
Re:Academia Is Eating Its Young by simonster on Sunday March 24, 2013 @03:14AM (#5431390)
> One high-impact, well-designed paper with strong conclusions could very well be worth more than 50 weaker papers.

This is true. Assessing impact is difficult, and journal impact factor is not a great proxy. However, at least in my field, most Nature and Science papers aren't worth 50 second- or even third-tier papers.

Re:Academia Is Eating Its Young by XorNot on Sunday March 24, 2013 @08:43AM (#5431895)
In my field (chemistry) plenty of people utterly loathe high-impact factor journal papers. They do something that looks impressive, but are a useless source of detail on _how_ it was actually accomplished, since more often then not they omit - not intentionally really - something which turns out to be very important to the process.

Several simpler papers not trying to be as dramatic are going to be far more insightful since you get the descriptions of what was found _not_ to work about the method they were trying to replicate. Weaker papers - to me - are gold, since they're what you publish when you were trying to copy something and it just doesn't work as well as is being claimed.

Re:Academia Is Eating Its Young by grest on Sunday March 24, 2013 @10:40AM (#5432163)
Yes, the risk-taking strategy of working towards a potentially high-impact publication is not worth the reward (as measured in citation rate comparing low-impact and high-impact articles )- see Foster et al Tradition and Innovation in Scientists Research Strategies http://arxiv.org/pdf/1302.6906.pdf
Re:Academia Is Eating Its Young by bokonist on Saturday March 23, 2013 @11:02PM (#5430902)
Who exactly decides how to allocate these grants? Professional federal government bureaucrats? Fellow professors in the field? Do you have any insight on why they choose to allocate the grants in such an inefficient way? Is the classic "no one ever gets blamed for buying the name brand" dynamic (where the famous professor is the "name" brand)? Or is it more sinister insider dealing and back scratching?
Re:Academia Is Eating Its Young by simonster on Saturday March 23, 2013 @11:33PM (#5430970)
I've never participated in the grant process, so I don't have the full information here, but I do know that grants are scored by other professors in the field.

Part of the problem is that the grants are numerically scored, and this scoring is primarily based on the merit of the proposal and the publication record of the lab. The lab budget isn't taken into account, and no one actually checks to make sure the project hasn't already been funded (see http://www.nytimes.com/2013/02/05/science/study-suggests-dup...). There is additional funding for young investigators, but otherwise, the funding agencies treat a process like they are funding a project, when in reality they are also funding a lab. The assessment is with regard to scientific impact, not scientific impact per dollar.

The "no one ever gets blamed for buying the name brand" dynamic is probably a factor, but I doubt it's a very big one. If you win a Nobel, it seems that you're guaranteed grants for life, but otherwise, your research still gets defunded if you don't produce anything for a while, even if you were once at the forefront of your field. People are probably more likely to vote to give grants to their friends, but I don't think there's systematic manipulation.

Re:Academia Is Eating Its Young by bokonist on Sunday March 24, 2013 @12:07AM (#5431055)
Interesting, thank you for sharing.

I think it's a major problem that there is no external accountability. The grants are scored by peer professors, based on publications (which again requires approval by peers). This creates a bunch of problems 1) it's very easy for entire field or subfield to go down the wrong track, and have no way of getting out of that track because the professors controlling grants and publications are the ones doing the bad research. 2) there is a bias towards publishing research that shows some new finding, rather than research that shows that they could not re-produce some previous science. The entire idea of basing science off of peer review is erroneous IMO, science should advance via replication.

In my ideal world, research would be funded in three, independent streams: 1) Prize based. The government would allocate a yearly budget of some very large amount of money - say $30 billion. It would create competitions and prizes in all sorts of fields. Example contests might include: self-driving car race, robot soccer olympics, longest battery life for $x of total materials used for making the battery, most yield of a plant strain per acre, etc. Teams would receive money for their research in return for placing or winning the contests. Research teams would also get money for achieving objective milestones:

2) Commission based. The government needs some new technology, maybe an upgrade of stealth tech for their fighter planes, so it pays a research institute to develop that tech. Unlink grant based funding, the commission is granted by the outsiders who need the tech, not by professors in the field giving to it to fellow professors.

3) Open Ended Institutional Funding. A certain number of reputable institutions should simply be given permanent annual funding. No grant process, no paperwork, no bureaucracy. The researchers would be overseen by an executive director, and the executive director would be overseen by a board of directors. The board of directors would consist of outside experts with a proven track record. For example, the board of a computer science research university would have people like Google's Urs Hölzle or Guido or Trevor Blackwell. The researchers would not have to apply for grants. They would just have to convince the board of directors that they were generally working on projects that had potential benefit to humanity, or else they would get fired. Every institution would be actually independent, governed by the personal judgement of that institutions board of directors.

Re:Academia Is Eating Its Young by vwinsyee on Sunday March 24, 2013 @01:32AM (#5431259)
Addressing #1: Most academic research the government funds is in basic science in expert domains, e.g. intercellular communication, neural firing patterns, etc, and much of this basic science is exploratory. For most projects, it would be difficult for everyone to agree on the goal and metrics of a competition. Sure, this might work for high-profile projects, e.g. establish a map of some organism's genome or connectome, or applied projects like your examples, but prize-based competitions would be difficult to implement on a large-scale. On another note, who would judge these competitions? For most domain-specific research, it would be peers in those domains -- so not much would be changed.

Addressing #2: This already exists. The government does contract out many tech projects, e.g. to Lockheed Martin or Boeing. Life science labs I've been associated with, have also received contracts from the NIH (as opposed to grants). While these aren't commission-based, these contracts are probably what you have in mind.

Address #3: This also already happens to a degree, typically with public research universities. Especially when a new center opens, the state + federal government will give some minimum funds for the center or institute to keep their lights on. But no funding is ever "permanent", especially when you have politicians slashing research budgets. Finally, it's interestingly that you mention that these institutions would be more or less under the complete control by an executive director or a BOD. The article mentions that having individuals of such power over a field (as these executives would have) stifles change, and I agree. It would be too optimistic to believe that these executives would not pick and choose projects of their liking, which is actually pretty much what currently happens. Plus, not having to submit grants virtually guarantees less accountability.

Re:Academia Is Eating Its Young by bokonist on Sunday March 24, 2013 @10:50AM (#5432198)
#1 I agree that prize-based research only works in certain areas. That is why I would make it only one of the three ways to fund research. I think that any competition should be judged by outsiders, if the competition cannot be accurately judged by outsiders then it is not a good competition. For instance, a self driving car race can be judged by outsiders.

For #3 the accountability comes from the board of directors. Right now the highest ranking professors are basically accountable to no one. If a field starts to stagnate, get to esoteric, or close off to new ideas, there is no one with the power to get it unstuck. The top professors do not have an incentive to get it unstuck, because they are the most successful in the status quo, their status is directly linked to the current direction of the field. An independent board of directors has no such perverse incentive. Also, each institution would be actually independent, unlike with the grant system in which grants are centrally allocated by a network of the existing professors. So if one institution goes the wrong direction, another institution might try and make its name by trying out a novel area of research.

Re:Academia Is Eating Its Young by impendia on Saturday March 23, 2013 @08:43PM (#5430523)
> Option b) is the path the universities took

You're sort of right, but we aren't deliberately weeding out people.

This year, I was on the hiring committee for a tenure-track mathematics hire in my academic department. The job market is extraordinarily competitive this year, and sucks rocks for candidates. It follows that we were able to hire somebody truly outstanding.

Re:Academia Is Eating Its Young by tsotha on Saturday March 23, 2013 @11:41PM (#5431001)
My question is what did you pay him? If the job market is really such a buyers market, instead of hiring one guy at $100k/yr, why not hire two at $50k/yr?
Re:Academia Is Eating Its Young by impendia on Sunday March 24, 2013 @10:47AM (#5432189)
I'm not sure, probably 75-80k, for the most part pay is very inelastic.

Whether fairly or not, I anticipate that any university attempting to pay below 50% the going rate would quickly get a very bad reputation. I would probably take a 50% pay cut to work at my dream institution, but I'm definitely in the minority (and also I don't have kids).

Re:Academia Is Eating Its Young by RougeFemme on Sunday March 24, 2013 @12:02AM (#5431044)
You might assume the total cost of those 2 options is equal, but when you look at the overhead/additional compensation (insurance, retirement, etc.) for each position, it might actually be cheaper to hire 1 at 100K rather than 2 at 50K.
Re:Academia Is Eating Its Young by w1ntermute on Sunday March 24, 2013 @12:44AM (#5431157)
> it might actually be cheaper to hire 1 at 100K rather than 2 at 50K

You're totally missing the point. The GP was just giving an example. Adjust the numbers however you want so that the latter option is cheaper.

Re:Academia Is Eating Its Young by josephhardin on Sunday March 24, 2013 @02:14PM (#5432893)
There is a bigger issue at work here. You can pay the one professor 100K, and have a slightly more relaxed professor that is likely to be more productive, or hire two at 50K that end up spending a large amount of their time looking for better opportunities, worrying about money, losing self esteem when comparing themselves to other professors that are making that 100K, etc. There is a threshold below which, you are just throwing away money.
Re:Academia Is Eating Its Young by monksy on Sunday March 24, 2013 @01:05AM (#5431199)
So what you're saying is that this is an overfitting problem?
Re:Academia Is Eating Its Young by yummyfajitas on Saturday March 23, 2013 @08:05PM (#5430415)
This is silly. It's purely a historical fluke that the role of professor (scientist/teacher) even exists.

There is no reason whatsoever why the same person should both create new knowledge and also teach calculus/cs 101/etc. I was good at research, but I sucked at teaching [1]. In contrast, many people are really terrible researchers, but actually pretty good teachers. (As you note, there is a glut of such people, so their wages are low.)

Separating these roles is a good thing.

[1] Due to a lack of standardized tests at the college level, I have no way to actually know this. But I do know my students didn't like me, complaining that I was too hard and unsympathetic.

Re:Academia Is Eating Its Young by bokonist on Saturday March 23, 2013 @09:12PM (#5430602)
My ideal world: Basic courses should be taught by professional teachers. Intermediate courses should be taught by practitioners who also have good teaching skills. So an junior year software engineering course might be taught by a Google programmer who was good at teaching and was taking a one year sabbatical from Google to teach. Or the course might be taught by a programming researcher who was good at teaching. Master level courses should basically be the student doing an apprenticeship under an existing master practitioner. So someone wanting to be a computer science researcher would apprentice with an existing researcher. Someone wanting to be an engineer at Google would do an apprenticeship at Google.
Re:Academia Is Eating Its Young by jessriedel on Saturday March 23, 2013 @08:45PM (#5430528)
It's hardly a fluke that the creation and dispersion of knowledge are tied together. The reason research universities exist is because undergrad were willing to pay money to learn from people at the forefront of knowledge. The problem isn't having (most) of those researchers teaching, it's that our society now wants to send 50% of people to college rather than the historical norm of order 1%. The researchers are spread too thin, and the mixed bag of lecturers must necessarily pick up the slack.

If you correct for the fact that the best researchers have zero incentive to teach (i.e. by just selecting those researchers and lecturers who are internally motivated to teach regardless of incentives) the researchers are way better on average.

There's a place for great researchers who suck at teaching or are so great at research that teaching is a waste, e.g. the institute for advanced study. (And frankly, most of the researchers at the institute should probably be teaching the best grad students.) But, as someone who was a grad student after going to a fancy undergrad school, I think it's clear that having most researchers teach is a fantastic Good Thing.

Re:Academia Is Eating Its Young by zanny on Saturday March 23, 2013 @08:30PM (#5430482)
I don't think it is a fluke, it was just a tactic to extract a guaranteed baseline real value from intellectuals where they could jump from research project to research project for years without a return.

Which is perhaps the greatest bane of capitalism - that which has poor returns in the immediate time frame is always passed over for instant results. It hurts our long run dearly to be so inefficient.

Re:Academia Is Eating Its Young by EliRivers on Monday March 25, 2013 @08:42AM (#5436651)
"There is no reason whatsoever why the same person should both create new knowledge and also teach calculus/cs 101/etc"

How about that the person using the tool every day in the course of their work is probably going to be the person best placed to teach others how to use it? Obviously teaching is a skill and craft that has to be taught, but given two people of equal teaching ability, the person using the tool every day should be the better choice, surely?

Re:Academia Is Eating Its Young by kkwok on Sunday March 24, 2013 @02:31PM (#5432957)
Taking your arguments though, is it clear that the lesson is teaching cannot be commoditized. Isn't it the lack of understanding and valuing of the research component that makes them see professors as adding little value? Programmers in most tech businesses do provide clear value through their work. So if anything the lesson seems to be it's not enough to do something valuable. You have to make sure the stakeholders understand and value it as well.

And in this regard I do agree we have a huge disconnect between modern research and people. To some degree this is because of the increasing complexity of the frontiers of research, but I also feel we no longer have the public figures in the research community who act as bridges and translators between academia and the public.

Re:Academia Is Eating Its Young by eli_gottlieb on Saturday March 23, 2013 @07:09PM (#5430205)
(due to the unsustainable nature of what it takes to get tenure, and midlife burnout)

I'm in academia right now, and this is indeed a problem. I generally only meet two kinds of academics: the perpetually tired (like myself) and the perpetually energetic. This may have something to do with the ways our bodies metabolize the utterly ubiquitous, universal stimulants (ie: loads and loads of caffeine) we take to cope with our relatively long working hours (it's not that unusual, for myself as a grad student or for many professors I've met, to start the day at 9:30am and finally leave for home at 7:30pm, then still be answering emails and doing work at home until it's time to sleep).

I'm perpetually tired because I keep developing a tolerance for the stuff every time I find a stronger coffee, and the habit of Israeli institutions is to start early in the morning, so I keep having to override my natural sleep rhythm with coffee -- thus requiring me to find ever-stronger caffeine sources even though what I really need is to just wake up somewhere from 8:30-9am and have one cup of black tea.

The moral lesson (and it applies to us as programmers, too) is that teaching (for us, documentation and outreach) isn't commodity grunt work. It's vital. It's often where most of the value is added. If you blow teaching off, the world will lose interest in you and pull investment. I would say "you deserve it" but, in the academic sphere, it's a different (younger) set of people getting whacked for it.

Hmmm.... I semi-object. It's not that teaching is unimportant, but that the whole dichotomy is really a spectrum. There's undergraduate-level teaching, graduate-level teaching, colleague-level teaching, documented research (ie: publishing), and your own research notes. The institutional problem is that you need a full spectrum of different methods and expectations for each role.

It's easy to say that we need to emphasize research less and undergrad teaching more, but what's really happened is that an originally unified role (the Full Professor of teaching and research) has grown apart, as the research frontier, and even the grad-level teaching frontiers taught to MSc and PhD students, pull steadily further and further away from the capacity of the undergraduate curriculum.

IMNSHO, we need to have a lot more respect for teachers, but we also just need to eliminate middle school. Ok, now that I have your attention: the skill level required to do Real Work, in both industry and research, has gone up, so we need to find ways to stop wasting our youth's time in redundant so-called education they neither want nor need and get them properly specialized and skilled once they show some talent and direction instead of just expecting to pump out Yet Another 1000 Engineering Grads.

Re:Academia Is Eating Its Young by spc476 on Sunday March 24, 2013 @12:14AM (#5431073)
By "middle school" do you mean the US 6th-8th grade (more or less)? Because in "middle school" I wanted to become a cartoonist, not the computer programmer than I ended up being. I personally think that specializing in middle school is way too early.
Re:Academia Is Eating Its Young by eli_gottlieb on Sunday March 24, 2013 @03:05AM (#5431381)
The point wouldn't necessarily be to start specializing that early, but that those years are simply unnecessary bullshit. Nobody I know remembers them being anything but a repetition of elementary school and a first introduction to the material of high school.

So it's probably easiest to just eliminate it, move kids directly on to high school or a vocational program, and graduate them three years earlier into higher ed, apprenticeships, or first jobs.