bazqux2
Customers want dashboards and Palantir provides excellent dashboard tooling. Dashboards make people feel smart and feel like they are learning something. But dashboards are not as useful as people think and usually fail to return enough value to cover the cost. As Palantir is so expensive the bar is higher and often not met - hence the losing of customers.
Customers need data models but they don't know it yet. The charts used with models are usually not interesting if they exist at all. If you did show charts of the data models to the customer it often makes them feel dumb and out of control - few people like that. They're also dependent on you to interpret the models and customers don't like that either.
So given the choice of comforting lie or uncomfortable truth the vast majority will choose the lie. So if you're in the business of selling comforting lies don't be surprised when they fail to work.
Given that you're building a descriptive model it would depend if you're working with facts or with probabilities. If it's facts then Ontologies should work fine, for probabilities I'd recommend Bayesian techniques.
The input for these are usually small. From the sounds of it you're generating the input yourself so you should be safe.
There is a whole generation of better techniques that have come out of machine learning that totally eclipses ontologies and I know Palantir isn't using them. Their corporate culture isn't set up for fostering that kind of applied research.
No-one is advocating for a fully automated approaches. I don't know where that notion came from.
In my view is that Palantir is a consulting company that is pretending to be a tooling company. And their consultants are not worth the money they charge. Just one of many Silicon Valley based frauds.
What I find interesting about this is that in effect Palantir is acting as a consulting company while pretending to be a software tooling company. This allows them to claim a higher earnings multiple to inflate value and extract more money out of VCs and offer a lower percentage of equity to employees. This is a very old trick. The problem is that consulting companies are much harder to scale than software companies and the inevitable disappointment will lead to a loss of equity.
There is good money in consulting (I am one) but it's hard to build a large consulting company when the 'tooling' companies can poach your talent away with cheap VC money and fairy tales about future piles of cash. It spoils the market. VC powered tooling companies masquerading as consulting companies are a real problem right now.
I worked on scaling and generalizing ontologies at university and had already switched to working with Big Data / ML at a big company when Palantir tried to recruit me. I talked to some of their senior engineers about their tech and made the point that their tech sounded just like ontologies. I tried to get them to admit what it was so I could be sure I was having an honest conversation with them. They flatly denied it and made it out like the whole thing was their great new idea. I was unimpressed.
I was still interested in working for them. Access to hard interesting problems can be hard to come by. In the end I couldn't take their legendary arrogance and insecurities - to me these are bright red flags of a toxic corporate culture. And they low balled me. I would have temporarily put up with the toxic culture for large piles of money.
A guy from BP told me in 2013 that they forked iPython, replaced all iPython references with Palantir and tried to sell it to them for $500K p.a.
For me; back in the day (2010) they were less secretive about their technology which was essentially an ontological reasoner. This was pre the Big Data hype boom - and AFAIK Palantir has never been about Big Data. Ontological reasoners have problems that prevent them from scaling or generalizing so they generally fail. Due to a long long history of failing ontological systems have a very bad name. But they look good for guided demos and has a ton of academic backing so it's easy to sell - as long as you call it something else - which is what they did. So if you want to use ontologies a better open source alternative software is Protege. But for the problems Palantir targets I'd recommend using standard machine learning technology where all the good stuff is open sourced.
As an aside, Peter Thiel also helped found Quid. A start-up that ripped off the Gephi layout engine and charges people $20K p.a. a seat. They've since rebuilt it but like Palantir it's still not solving people's problem and they've evolved into a consulting firm.
There is already a lot of information out how bad Palantir is. I hear from friends who work there that the BuzzFeed article on them is accurate. In short, like much in the valley, Palantir financially set up as an unmaintainable pyramid scheme.
One way for them to get out would be to pay Goldman Sachs to get Meg Wittman use HP shareholder money to buy Palantir at face value. This worked for Autonomy - a similar scam 'Big Data' company where the founders got away with it.
But... this is the same company that was giving out work quotes in less than 10 minutes. I expect gigsters existence is subsidized by VC investment and it will be unable to succeed long term. I'm not expecting good things for anyone involved.
As an aside; is it racist to assume all white men have the same culture?
I made the assumption on the top post that they were in-house proprietary software given the reference to keeping everything in git.