News for hackers. Stuff that matters.
Re:Ted versus The Media Lab [video] by xiaolingxiao on Tuesday January 28, 2020 @10:10AM (#22170060)
This is well known in academia and exist outside of Media Lab as well. For example, I asked a professor (not associated with the Media Lab) about using hype to get grants. He said: "It's just like the stock market right, money goes here, it goes there, it's all story telling. I have to tell stories too because if I don't, then other people will tell this story and get the money. But I think I can use it better than other people." This is a very "well-respected" Ivy League professor in applied machine learning.

As for the Media Lab, they're really selling the image of technological progress. And Corporate entities find value in this exact image because they're just reselling it to their shareholders, many of whom are dumb money. But the image is required to attract idealistic and clueless grad students who'll sacrifice their lives and sanity to make demos. I know several people who graduated from the Media Lab with masters/doctorates, and they are all of this exact mold: taken captive by pipe dreams and their own delusions of what this stuff could do, while their advisors are churning through students and packaging new narratives.

Re:Ted versus The Media Lab [video] by EthanHeilman on Tuesday January 28, 2020 @10:43AM (#22170381)
I see nothing wrong with professors communicating the value of what they are building as effectively as possible. If you believe a problem is an important problem to solve then you should work hard to convince other people it is important.

>As for the Media Lab, they're really selling the image of technological progress.

Disclaimer: I've worked with researchers at the DCI group in the media lab on hash function cryptanalysis.

The media lab is made up of a large number of research teams doing very different stuff. It is unfair to just say "the media lab does X or operates like X". Look at the research from the DCI group at the media on zero knowledge proofs systems [0], hash-based accumulators [1], or work on Ring Signatures [2].

[0]: zk-sharks combining succinct verification and public-coin setup https://dci.mit.edu/zksharks

[1]: utreexo: a dynamic accumulator for bitcoin state https://eprint.iacr.org/2019/611.pdf

[2]: It wasn't me! Repudiability and (Un)claimability of Ring Signatures https://eprint.iacr.org/2019/135.pdf

Re:Ted versus The Media Lab [video] by appleflaxen on Tuesday January 28, 2020 @12:24PM (#22171543)
> The media lab is made up of a large number of research teams doing very different stuff. It is unfair to just say "the media lab does X or operates like X". Look at the research from the DCI group at the media on zero knowledge proofs systems [0], hash-based accumulators [1], or work on Ring Signatures [2].

I have no dog in the fight, but I feel like if any entity is branding itself as a discrete entity, then you take the lumps of the branding just as you take the brand recognition. If you're "part of the MIT Media lab", then this affects your reputation in the eyes of the public.

Re:Ted versus The Media Lab [video] by wpietri on Tuesday January 28, 2020 @01:52PM (#22172761)
Exactly. I really don't like the rhetorical trick of taking a generalization and disputing it because it's not absolute. Especially when, as you say, the people involved have chosen to carry that banner proudly.
Re:Ted versus The Media Lab [video] by xiaolingxiao on Tuesday January 28, 2020 @12:08PM (#22171334)
> I see nothing wrong with professors communicating the value of what they are building as effectively as possible.

Oh for sure, the grad student get value out of it because there's someone established advocating their work. For people w/ no reputation and marketing know-how, being cross-selled like this is of value, in fact it's one of the primary value add of the PI.

> The media lab is made up of a large number of research teams doing very different stuff.

Yeah fair, wish I knew more about cryptography so I can comment. In general, I don't think narratives are "bad" per-se, or they are strictly less valuable than rigorous mathematically proven technical work. For example every nation has a shared myth/narrative right, and US's myth of freedom of thought and social equality encourage lots of people to try hard, which I think of as a good thing in general.

Re:Ted versus The Media Lab [video] by netcan on Tuesday January 28, 2020 @12:09PM (#22171342)
If you are funded by a grant process (or similar), you are shaped by it.

The most common complaints form the inside are political games or PR games... like here. Either whoever has the best connections wins or whoever has the best (most?) image wins.

Remember Banksy's shredder prank? He shredded a multi-million-$ drawing at the auction. Presumably this was some sort of angry gesture towards the art-buying world. I think it's the same sentiment Ted expresses here.

A lot of researchers are idealistic, like many artists. They don't like "hype and hokum," and they take offence at how much influence PR has. It's cheapening. The value, potential or importance of research is being determined by a spokesman who doesn't understand (or care) about his own inaccuracies. The granter is obviously dumb too, judging by the dumb PR used to court them. Neither seem to care about truth. How is it possible that these dummies decide so much.

I'm guessing Banksy hates that idiot art dealers and buyers decide the value of art.

Them's the breaks though.

Re:Ted versus The Media Lab [video] by catalogia on Tuesday January 28, 2020 @12:26PM (#22171556)
The guy who bought the painting prior to it being shredded decided to keep it, which was probably smart since that media stunt made that painting famous and doubtlessly more desirable than it was before being shredded. Maybe Banksy hates the guy for buying his art, or maybe Banksy did the buyer a favor.

Also, the story of the shredder being prepared years in advance reeks of bullshit. And if that part of the story is bullshit, I can't help but question the rest.

Re:Ted versus The Media Lab [video] by netcan on Tuesday January 28, 2020 @12:53PM (#22171963)
Presumably, Banksy knew well that the stunt would increase the value of the drawing. So on some level, non-naivety is likely no matter what.

That said, it's still a commentary on the "art world." The unidealistic ways & reasons art is bought and how the value of art works... contrast to the idealistic artist destroying his work rather than having it denigrated. It's also inevitably hypocritical because the artist is either benefiting from the whole hype and hokum or wishes to be.

My guess is that the last part is why this is such a common navel-gazing motif in art. The heart at odds with itself. Idealists always struggle with all the hypocrisy, especially their own. Poor things.

Re:Ted versus The Media Lab [video] by wrycoder on Tuesday January 28, 2020 @12:55PM (#22171976)
I doubt that what came out the bottom was the original. I’ll bet that the exhibit can be rewound and replayed.
Re:Ted versus The Media Lab [video] by SZJX on Friday January 31, 2020 @09:54AM (#22202093)
I doubt that's what Banksy would have intended though. Wouldn't surprise me at all if he just actually shredded the work.
Re:Ted versus The Media Lab [video] by leetrout on Tuesday January 28, 2020 @03:12PM (#22173573)
That was my first thought when I saw it as well. Reminded me of a magician's setup.
Re:Ted versus The Media Lab [video] by fmajid on Thursday January 30, 2020 @08:02AM (#22191014)
Piero Manzoni's "Mierda de Artista" (literally canned shit) was his way of protesting against the commercial art establishment. They laughed all the way to the bank by selling it for its weight in gold.
Re:Ted versus The Media Lab [video] by api on Tuesday January 28, 2020 @11:12AM (#22170683)
A cousin of this is what one researcher in the field of evolutionary machine learning called "dullwashing" to me in a conversation about academic funding.

If he wants to do some really interesting somewhat outside-the-box work, he often has to find some way to make it look incredibly dull and inside-the-box and incremental in order to convince some funding bureaucrat to fund it.

Most money is dumb and flows in a herd-like manner into things that look superficially like things that have been successful in the past. This includes stock market money, government money, and yes even VC money. You often have to trick the world into funding genuinely interesting or productive work. Without a bit of marketing money will just chase the latest bubble or fad. It's like you have to save money from itself. If truly creative and productive people don't lay on the marketing, money will instead flow to charlatans who do... see also WeWork, Juicero, etc.

Re:Ted versus The Media Lab [video] by panic on Tuesday January 28, 2020 @11:23AM (#22170806)
> Most money is dumb and flows in a herd-like manner into things that look superficially like things that have been successful in the past. This includes stock market money, government money, and yes even VC money. You often have to trick the world into funding genuinely interesting or productive work.

The last few decades of US economic policy has been based on the idea that private investment is more effective than taxing and redistributing money. But as it turns out, it's not just the government that's dumb -- all large investors behave in this dumb, herd-like way. And at least governments are more comfortable spending money without expecting a return.

Re:Ted versus The Media Lab [video] by api on Tuesday January 28, 2020 @11:25AM (#22170829)
Yeah the supposed genius of private markets has been massively oversold.

I really think the power of capitalism lies not in some magical ability of markets to make good decisions but in the freedom it affords to route around bad decisions and the bureaucracies and corporate institutions that make them.

In a vertically integrated Soviet-style economy a single bad bureaucracy results in the total failure of that industry. It's not really possible to sidestep it; there is no "permission free innovation." In a free market those big dumb slugs still exist but it's at least possible for some people to go around them.

Re:Ted versus The Media Lab [video] by SZJX on Friday January 31, 2020 @09:40AM (#22201973)
i.e. basically what Taleb mentioned repeatedly in his books: The power of capitalism lies in its capability to allow people to freely explore all sorts of potential ideas. Many, or even most of them will fail, but some of them will get lucky and hit the mark. Many inventions/breakthroughs throughout the history were achieved "by accident" instead of intentionally/in a planned manner.
Re:Ted versus The Media Lab [video] by dkonofalski on Tuesday January 28, 2020 @11:54AM (#22171186)
I'm not sure why this is getting voted down except for maybe your tone because this is my experience in so many different things. I've worked for several marketing firms in the past and the quickest way into investors' hearts is to pitch them your idea reframed as a combination of things that are already successes. For example, we worked with a video game developer and their pitch was "It's like GTA mixed with Call of Duty" or for TV show pitches it's always "It's like The Good Place meets Dexter" or some permutation of already existing properties. Investors don't ever (or at least almost never) want to go for the risky ideas. They want to go for the things that will make them money and the easiest way to win them over is to compare it to something that's already made money.
Re:Ted versus The Media Lab [video] by rjsw on Tuesday January 28, 2020 @12:55PM (#22171986)
We even have a name for it [1].

[1] https://en.wikipedia.org/wiki/High-concept

Re:Ted versus The Media Lab [video] by zaroth on Tuesday January 28, 2020 @11:09AM (#22170646)
> I know several people who graduated from the Media Lab with masters/doctorates, and they are all of this exact mold: taken captive by pipe dreams and their own delusions of what this stuff could do, while their advisors are churning through students and packaging new narratives.

I have a pretty hard time with the theory that Doctoral MIT graduates are an exploited underclass.

Doctoral students everywhere are overworked and underpaid. Same as almost everyone, really. But the Doctoral students do get to walk away with, and heavily monetize that credential at the end of it.

And if they are doing work on aspirational “pipe dreams” pursuing a dream of the future that doesn’t pan out? Rather than what, punting on the dream and getting back to the hard work of CRUD apps and monetizing clicks?

Re:Ted versus The Media Lab [video] by mattkrause on Tuesday January 28, 2020 @11:39AM (#22171008)
> Doctoral students...heavily monetize that credential at the end of it.

Ha! If only! To continue doing research, the usual next step is a postdoc (~$50k/yr). Industry positions pay better, but outside of ML, there aren't tons of them and biotech (for example, which the media lab does) salaries aren't crazy high.

I'd bet that anyone with a PhD could have made more money with a masters degree and a switch to industry.

Re:Ted versus The Media Lab [video] by jvilk on Tuesday January 28, 2020 @11:46AM (#22171088)
> I'd bet that anyone with a PhD could have made more money with a masters degree and a switch to industry.

This is common knowledge for those pursuing CS PhDs. You don't do it for the money. If you only care about money, a master's degree is what you want.

Re:Ted versus The Media Lab [video] by exdsq on Tuesday January 28, 2020 @11:54AM (#22171179)
A lot of jobs I have seen recently say a PhD is highly desirable while a Masters is essential. Obviously I don't suggest people start doing a PhD for the money, however I'm surprised to think that you can't out-earn your alternative self with a Masters seeing as the difference in study time is 2 years but you'd be entering industry as an 'expert'. Especially if you target your PhD at something like computational finance, autonomous vehicles, etc.
Re:Ted versus The Media Lab [video] by mattkrause on Tuesday January 28, 2020 @12:25PM (#22171548)
I'd lump those fields into "ML" and the difference is probably more like 4 years in the US (2 vs ~6).

The career consequences are also weirdly mixed. Some places seem to recognize that, along with your area of specialization, getting a PhD also involves a fair amount of project management, writing, etc skills. Other places (or even different people at the same place), seem to think it's a glaring red flag that you can't "get real work done" because you sit around all day in a smoking jacket, thinking. (I think that's mostly bunk--academia moves fast these days, but that sentiment is nevertheless not uncommon).

And, if anyone has actual advice on monetizing a comp/neuro PhD, I'm all ears :-)

Re:Ted versus The Media Lab [video] by edw on Tuesday January 28, 2020 @12:55PM (#22171991)
Job requirements are often inflated to scare away people without the ambition, egomania, and/or self confidence that the writer of the description desires. The business/management job description equivalent of this is "MBA from top-ten business school essential."
Re:Ted versus The Media Lab [video] by exdsq on Tuesday January 28, 2020 @11:51AM (#22171146)
A PhD can help with jobs that don't really require a PhD, especially in finance. I have a few friends who ended up joining large investment banks after their DPhils at a higher level than those who had joined straight after their bachelors as analysts and worked up. This is in the UK though, where PhDs can be 3 years and completed immediately after a bachelors, so they were entering the job market at 24/25.
Re:Ted versus The Media Lab [video] by darkmighty on Tuesday January 28, 2020 @12:30PM (#22171611)
Research is, almost by necessity, based on "pipe dreams". If there's certainty of outcome it isn't research, and most likely doesn't belong in academia.

Second, well, private investors give money to whoever they want. If they believed they'd get most out of their money by just following some academic metric like citation count or impact factor (and throwing money at them), that's what they'd likely be doing; I don't think this would work all that well for them, do you? For one it's very hard to come up with any objective metric that can't be gamed, distorted, etc. The Media Lab has a rich history of collaboration with industry and yes developing innovative products/ideas. They promote this history, and I don't think there's anything wrong with that.

Re:Ted versus The Media Lab [video] by diydsp on Tuesday January 28, 2020 @11:24AM (#22170808)
>they're really selling the image of technological progress.

That's such a broad brushstroke.

Consider, for example, Echo Nest's research in machine listening in Barry Vercoe's Music, Mind and Machine group. This all made it into Spotify when they acquired Echo Nest. His work led and pushed other researchers in the field at ISMIR, etc. Hard to downplay the impact of Spotify on our culture. This is not "hokum."

And as I shoulder-surfed the whole thing, I can tell you it started out as a crazy dream. When Brian Whitman and Barry began it, CPU power was meager, GPUs were scarcely recognized as general computation aids. It was mostly about music similarity instead of social features. (I like to think I helped Brian think that way, egoist I am). Even storing 1,000,000 songs was once difficult. This was in the AJAX and perl days.

But like Brian's daydream, many other projects there are daydreams. That's the point of the ML, to try the daydreams other people won't. Not to disrespect others for taking on research more likely to result in tangible results. In fact, that's very sane! So if you want to critique the place according to some personally-applied standards, that's great, that's your opinion, next.

Re:Ted versus The Media Lab [video] by Chinjut on Tuesday January 28, 2020 @11:29AM (#22170891)
Spotify's impact on our culture is "People like to stream music. Here is a service that lets them do so.". You didn't need the Media Lab to come up with that idea, and indeed, it didn't.
Re:Ted versus The Media Lab [video] by Teever on Tuesday January 28, 2020 @11:34AM (#22170954)
Yeah OPs comment is some sort of idealistic historical revision that ignores the fact that there were a myriad of streaming services that predated Spotify.

It's a pretty weird thing flex about too. Like isn't streaming music based on preferences pretty easy?

Re:Ted versus The Media Lab [video] by nessus42 on Tuesday January 28, 2020 @06:19PM (#22175268)
> Yeah OPs comment is some sort of idealistic historical revision that ignores the fact that there were a myriad of streaming services that predated Spotify.

That may be true, but Negroponte was proselytizing streaming media back in the early 90s, long before anything like Spotify or Netflix were actually practical. Did all this hot air have any effect? I have no idea. But from where I was sitting, he was definitely pushing hard for something that others were not at the time.

Also, the first music recommendation service I ever heard of was started at the Media Lab. It was called Ringo, and you'd email it a list of your favorite bands, and it would then email you back recommendations for other music you might like. Ringo was implemented using some sort of statistical correlation amongst other people's lists of favorite bands.

Ringo was eventually spun off into a company called Firefly which ran a music community website that used this technology. It didn't do so well, though, and was eventually bought by Microsoft, which shut down the website about a year later.

> Like isn't streaming music based on preferences pretty easy?

Sure, but I don't think that doing it very well is. I mean they typically do an okay job, but I've yet to find one that just blows me away with its ability to find music for me that I will love.

Yes, I'm introduced to some good new music this way. But I also have to listen to a lot of dreck too.

Re:Ted versus The Media Lab [video] by saalweachter on Tuesday January 28, 2020 @06:38PM (#22175408)
In terms of mass-market success, goodness of recommendations is like, #12 on the list of must-have features for a (streaming) music service.

#1 is "It must have all of the music", which is really a lawyer problem, not an engineering problem.

(#2-#11 are just variations of "No no, I mean all the music", "Does it have really old music, like X?" "What about really niche music like Y?" "Oh, oh, what about Z? I bet it doesn't have Z.")

Re:Ted versus The Media Lab [video] by nessus42 on Tuesday January 28, 2020 @06:45PM (#22175467)
> In terms of mass-market success, goodness of recommendations is like, #12 on the list of must-have features

Well, maybe that's why they generally are not so great.

On the other hand, Pandora has traditionally existed with playing music that you'll like, but didn't explicitly select, as its reason for existence. Maybe that's why it seems to do a better job at this than other streaming services.

Re:Ted versus The Media Lab [video] by spookthesunset on Tuesday January 28, 2020 @08:05PM (#22176081)
> Like isn't streaming music based on preferences pretty easy?

That must be why Spotify constantly fills my once useful “discover weekly” feed with what I would describe as “Ambient Indian Buddhist Trip-Hop”. Not really what I wanted at all. Though this week it seems to be “Ambient Irish Bagpipe”, which is also not at all what I wanted.

So, no... I think Spotify has a long ways to go to learn how to give me what I want...

Re:Ted versus The Media Lab [video] by SamBam on Tuesday January 28, 2020 @12:03PM (#22171296)
> Like isn't streaming music based on preferences pretty easy?

No, I don't think so.

Millions upon millions have been spent pouring money into recommendation engines (which is an advanced "based on preferences"). Companies like Netflix know that they can keep customers that much longer if they're good at finding the needles in the haystack for each specific customer, and they famously offered a million-dollar bounty to anyone that could improve their algorithm by even a few percentage points (and, just as famously, everyone recognized that it would be worth far more than a million dollars to them).

Pandora tried to do it by creating a "music genome" for every single song in its database, with dozens of attributes per song, thus linking disparate songs though much more than just "genre."

Nowadays it's pretty much "throw a massive database at a ML system, and pump out 'people who like these 10 songs tend to like this song'", but for a long time those systems were crappy. And, even now, its hard for those systems to find a balance between showing you something that matches what you've listened to, and playing you ten nearly-identical songs in a row.

Re:Ted versus The Media Lab [video] by diydsp on Tuesday January 28, 2020 @11:37AM (#22170981)
Why do you think they acquired Echo Nest for 50 million euros? It's the music discovery engine, not the streaming.[0]

[0] http://the.echonest.com/pressreleases/spotify-acquires-echo-...

Re:Ted versus The Media Lab [video] by Chinjut on Tuesday January 28, 2020 @11:40AM (#22171012)
Companies make all sorts of acquisitions, insightful or random. The acquisition of Echo Nest certainly isn't the reason for "the impact of Spotify on our culture". I assure you, Spotify's success was in its licensing a very large selection of music to stream. Everything else is marginal.
Re:Ted versus The Media Lab [video] by azinman2 on Tuesday January 28, 2020 @11:52AM (#22171150)
Not true at all. Do you think Facebook would be as big without their feed, or YouTube as big without recommended videos or their front page?

Recommendations and turning that into useful products (like auto generated playlists, mood playlists, upcoming talent, etc) are a huge draw to Spotify and creates a high bar for new competitors (including Apple Music).

Re:Ted versus The Media Lab [video] by catalogia on Tuesday January 28, 2020 @11:55AM (#22171191)
> It's the music discovery engine,

Didn't the Music Genome Project / Pandora do this half a decade before Spotify?

Re:Ted versus The Media Lab [video] by diydsp on Tuesday January 28, 2020 @12:51PM (#22171928)
that's a great question - those approaches where based on acoustic similarity. Later approaches, including Echo Nest, included social features.

An example I used to use with Brian was that Bad Religion and NOFX sound similar. However, fans of one of those bands weren't often fans of the other. In this model, people have a need for an amount of that sound and a social connection, NOT a need for more and more and more of that sound.

Another diff is that Pandora used human music experts where EN used machine listening. They have some overlap, and some differences, but obv the machine listening is offline.

Re:Ted versus The Media Lab [video] by proximitysauce on Tuesday January 28, 2020 @11:56AM (#22171200)
Spotify acquired Echo Nest in 2014. Spotify was already wildly successful at that point, and were latest in a long line of music streaming services that came before them. They also already had recommendations. It was basically an acquihire and most of the team has already left.
Re:Ted versus The Media Lab [video] by sdellis on Tuesday January 28, 2020 @02:17PM (#22173037)
This is not true. There are recommendation algorithms and there are recommendation algorithms. Spotify's VP of Engineering in the US contacted me in July 2011 due to my work with EchoNest and wanted to know what my experience was. His story was that Spotify was interested in longtail music discovery and recommendation algorithms. I still have my correspondence with him and I'm happy to share if you need more proof.
Re:Ted versus The Media Lab [video] by proximitysauce on Tuesday January 28, 2020 @02:29PM (#22173158)
I believe that they wanted to hire you.

There were a ton of music recommendations available at the time. Every music service had them: Rhapsody, Yahoo! Music Unlimited, Last.fm, Mog, iTunes, Grooveshark... Echo Nest's weren't even that good. I don't think they had song level recommendations iirc.

Re:Ted versus The Media Lab [video] by sdellis on Tuesday January 28, 2020 @03:12PM (#22173571)
EchoNest's were the best at the time because they added social data into the mix. They analyzed people's playlists/libraries to generate recommendations when everyone else was using descriptive metadata, audio comparison, or manual curation.
Re:Ted versus The Media Lab [video] by proximitysauce on Tuesday January 28, 2020 @03:25PM (#22173685)
That's incorrect. Most of those services were using collaborative filtering social data to drive their recommendations.
Re:Ted versus The Media Lab [video] by throwaway_tech on Tuesday January 28, 2020 @11:49AM (#22171114)
>Hard to downplay the impact of Spotify on our culture.

I'd say it be hard to convince anyone that Spotify has had any material impact on our culture...but here we are. Music (sure); the internet (sure); smart phones connecting us wirelessly to the internet (sure); a single music streaming app with countless competitors (I have heard the name Spotify, but never used it, and yet I still stream music everyday...just don't see any impact on our culture)

Re:Ted versus The Media Lab [video] by tomp on Tuesday January 28, 2020 @12:02PM (#22171278)
Spotify's biggest impact is legal "free" music. It's not even a technological innovation (in fact, their technology sucks - I can't even reorder or duplicate playlists!), it's just a legal innovation (or "innovation", as Uber would say).
Re:Ted versus The Media Lab [video] by mstade on Tuesday January 28, 2020 @01:49PM (#22172717)
Back in about 2007-2008 sometime I was given an invite to Spotify, when it was still very much in stealth mode. In Stockholm at the time it was the talk of the town in hip web agency circles, and the question of why it wasn't a publicly available product tended to come up. Someone told me that the main reason they were in stealth mode still, despite having a pretty solid product at the time, was that the entire library of music was ripped off of CDs and not licensed, and they were working towards getting the labels on board.

The explanation made sense to me and would support your point of view, but sadly I don't know if it's actually true as I heard it from someone not actually working for Spotify.

Re:Ted versus The Media Lab [video] by vilhelm_s on Tuesday January 28, 2020 @11:33AM (#22170931)
I guess it's not specific to academia either. Startups work exactly the same, they tell stories to investors to get grants, and are often staffed with idealistic people straight out of college.
Re:Ted versus The Media Lab [video] by jancsika on Tuesday January 28, 2020 @10:41AM (#22170356)
Just to add another data point: I asked an Ivy League professor about hype and they said the exact opposite of your Ivy League professor.

Anyway, that's certainly the hype part that your anecdote refers to. Now how about the hokum? Did your Ivy League professor draw a computer on a cardboard box and put a kid inside there? Or did they use it for a bona fide machine learning research project?

I think those are fair questions as there's at least one story of a Media Lab project that misrepresented its technology and did not really perform the tasks which it claimed to have performed.

Re:Ted versus The Media Lab [video] by xiaolingxiao on Tuesday January 28, 2020 @11:24AM (#22170809)
Hmm it's a bit more subtle than that. There are all kinds of ways to misrepresent progress, the simplest way is to pick bogus metrics. For example, all of machine-learning based dialog system work uses metrics that were designed for machine translation ( basically n-gram overlaps ), this is an example of a metric that you can improve on but is meaningless. So the resulting system is very much the dog-and-pony show variety. Or people who use simulations to train and test ML systems, and say the metrics get better but do not address the sim2real gap.

> I asked an Ivy League professor about hype and they said the exact opposite of your Ivy League professor

The context matters, I have heard the opposite response as well, from a professor I was working for, while he was doing just that: packaging narratives w/o regard to how well the methods actually work. The honest take came at a wine-and-cheese party from a professor I was not working for. There is a real conflict of interest here, and if people stand to gain by withholding information, they will do Just that.

Re:Ted versus The Media Lab [video] by dkonofalski on Tuesday January 28, 2020 @11:42AM (#22171047)
Just curious but what's the exact opposite of those statements? That he hasn't had to convince anyone of their work in order to get money? Or that it isn't based on that but on results? As someone that doesn't live in that world, I have no idea what the "exact opposite" of that really is.
Re:Ted versus The Media Lab [video] by mattkrause on Friday January 31, 2020 @10:34AM (#22202478)
For research funding, the sweet spot is the flashiest idea that seems extremely likely to work.

It’s hard to get grants to try something really out there, especially from the NIH or NSF; DARPA is a bit more adventurous. Pilot data helps with this, but those experiments cost money too, so one approach is to make the project sound almost, but not quite, obvious in light of existing work.

At the same time, it’s also really hard to get funding to confirm something that everybody “knows”, even when the underlying data is actually not very convincing. These experiments need some hype.

Re:Ted versus The Media Lab [video] by toomuchtodo on Tuesday January 28, 2020 @10:17AM (#22170113)
The parallels to SV, VCs, and the startup ecosystem are striking.
Re:Ted versus The Media Lab [video] by xiaolingxiao on Tuesday January 28, 2020 @10:25AM (#22170194)
Yeah I think overt exploitation is what happens when you have a situation where there is very thin or no layer of management between the most savvy players of the game ( professors, founders or VCs ) and fresh meat ( engineers or grad students ). They're both situations where the predators walk freely amongst the prey and take as they please. Also SV was an extension of academic-military-industrial complex, and they both engage in high risk projects that don't necessarily pan out.
Re:Ted versus The Media Lab [video] by CalChris on Tuesday January 28, 2020 @11:42AM (#22171034)
You should group founders with the engineers and grad students rather than with the VCs. We have to figure out a market opportunity and a product to fit it, seed that ourselves, eat ramen, pitch it, recruit for it and then make it and sell it. We do all that for well below market rate wages for a chance a big return. Moreover, founders get common stock, same as engineers.

VCs get a management fee and a carry. They also invest some money into the fund. Their management fee de-risks them entirely.

You can't group VCs and founders on one side and engineers on the other. It just doesn't make sense.

Re:Ted versus The Media Lab [video] by TheOtherHobbes on Tuesday January 28, 2020 @12:31PM (#22171623)
It depends on the founders.

Arguably the most financially successful founders are marketing-led, not technology-led. And some are perfectly happy to set up low-to-zero prospect companies, raise millions through networking and confidence, spend the millions with a good chunk going on their own salary/expenses, apologise to everyone in a punchy yet apparently humble post-mortem when the idea fails, and then do it all again.

In reality startup land is a scammer's paradise on all sides. Some people knowingly run a con, some are delusional, some are sincere but unlucky and/or lacking the skills/contacts/presentation to make a good idea work.

All of the above can get funding, especially in boom times. So there's surprisingly little pressure to build an ethical, product-focussed, engineer-friendly, stable business with lasting potential, and plenty of reward for not doing so.

It shouldn't be a surprise if there are people who take the bait - on any of the possible sides.

Re:Ted versus The Media Lab [video] by xiaolingxiao on Tuesday January 28, 2020 @11:48AM (#22171110)
Ok yeah fair. Some founders are better situated than others, but in general yeah most get the raw end of the deal.
Re:Ted versus The Media Lab [video] by smacktoward on Tuesday January 28, 2020 @10:40AM (#22170351)
In a capitalist system, the easiest things to raise money for are monuments to the wisdom of capitalists.
Re:Ted versus The Media Lab [video] by kanzure on Tuesday January 28, 2020 @10:40AM (#22170352)
> I have to tell stories too because if I don't....

Sounds like reputation afforded to academia (professors) might be inappropriate. Besides, science shouldn't be judged by reputation but by fact and result. The idea of evaluating the quality of an idea by one's social standing is sort of odd... for someone who should be preaching science.

Re:Ted versus The Media Lab [video] by bildung on Tuesday January 28, 2020 @11:03AM (#22170578)
This is what you get when you introduce market mechanisms into research institutions. If the researchers have to solicit external sources of finance, they effectively become (part time) sales people.

As the financial sources are by definition external, the people behind them have no clue about the actual research. So what can the researchers do to close the sale, if the actual science won't work? They necessarily have to tell stories.

Re:Ted versus The Media Lab [video] by dkonofalski on Tuesday January 28, 2020 @11:44AM (#22171068)
I agree with this 100%. I'm a data scientist that works with large demographics and just putting data out there to people does nothing. You have to tell a story around it and give it context for it to make any sense to most people. The most important part is sticking to objective statements about the data and then justifying the actions that are a result of new data.
Re:Ted versus The Media Lab [video] by OnlineGladiator on Tuesday January 28, 2020 @11:22AM (#22170797)
> So what can the researchers do to close the sale, if the actual science won't work?

Maybe the problem is that the science won't work and they're trying to spin it otherwise.

Re:Ted versus The Media Lab [video] by maccam94 on Tuesday January 28, 2020 @11:49AM (#22171115)
Sometimes you have to spend resources before you can reach a conclusion, which is is a risk. People are always looking for low risk/high reward investments, and when they're unable to evaluate an investment for themselves they incentivize optimistic proposals.
Re:Ted versus The Media Lab [video] by apsanz on Tuesday January 28, 2020 @10:48AM (#22170420)
This is pretty idealistic. Humans use reputation to judge everything. Even if we could bend human nature in this one area, how would it work? Who is really in a position to judge cutting edge research? Only other good researchers can really understand and judge someone's research. How do you tell who the good researchers are without reputation? How do you know how much each person is contributing to each insight? You quickly see that the same group of people need to judge each other and then you are at the whim of social dynamics and bias of the group.