If you have an all new product you need to get into the market fast. Once you have the basic features working you need to see if customers really exist. Even if it means your customers have to try everything twice because you crash the first time, if they buy your product you fix the bugs they see so that it mostly works and move on.
However if you don't have a new product you cannot do that. If you want to release something where the market already exists you can just do one part better you need to be as good in everything else. Tesla didn't release their original roadster without a heater, in the 1950s heaters were optional.
You need to figure out which market you are in and release accordingly. Getting this wrong means the death of your company. If you are in the first investors are taking a risk that people will want your product - it would be stupid to invest in perfection when customers might decide your product doesn't fill a need, better to abandon your interesting but useless product early. However when you are in the second you need to meet your user's expectations - thus I don't need to check the feature list to tell you Tesla comes with a working heater standard. Expectations is also why the early reviews of Tesla showed a tow pulling it away with a dead battery - the equivalent stupidity in a gas car would be the tow truck charging $10/gallon for gas and you are on your way in a few minutes. (Tesla has been mostly successful in managing expectations in the years since - now everyone knows it isn't the best car for cross country trips but you can do it once in a while with a little planning - there is a lesson in this too when you are a little different in an existing market make sure the downsides of your different are understood)
Aggregating their reviews would cancel this effect out though.
Also, there's the risk of aggregate counts simply reflecting the population of each job function, unless you weight them. Then it'll just say that every engineering-focused startup failed for engineering reasons and every sales-focused startup failed for sales reasons, which may be true but isn't terribly helpful for a founder trying to figure out what to do.
It's because of that case I think free-form postmortems might be more insightful, despite their own obvious faults. Perhaps NLP and sentiment analysis could shed some light.
Not always. Changing a single person's bad habits or tendencies is hard enough. 10 people? 100? Culture carries momentum even if the prime mover is found.
Then the challenge becomes a game of synthesizing contradicting perspectives. That's what makes this exercise of distilling causes into "bitesized pieces" so difficult.
In most cases, there is, of course, no simple way to pinpoint a particular place where everything ran amok. That's to be expected. The analyst needs to listen to everyone with credible knowledge of the company and use their own judgment to come to an opinion on the biggest issue. This is a subjective analysis, and not something that can be authoritatively established.
Often times in an early stage startup the problem is the team doesn't gel enough to adequately explore the problem space. In those cases, the founder might conclude that the opportunity wasn't there, but maybe it's because people weren't aligned enough to push far enough in the right direction. It's impossible to know whether there was really a viable business there, or whether it was a failure of the team. But subjectively after going through several startups and other early stage projects, I know the feeling of a team that is gelling, and it can make an unquantifiably huge difference to early results.
This really resonated with me. It's truly a skill to build the self-awareness to realize when you're the problem. It's much easier to externalize or abstract the problems away, particularly in stressful times where everyone feels overworked. I've caught myself doing this.
I have to set aside part of every week to step back, breathe in, and candidly examine how I might be contributing to problems that are happening. Otherwise it's too easy to get wrapped up in the hunt for demons outside the burning house.