News for hackers. Stuff that matters.
Re:NHS to investigate Palantir influencer campaign as possib... by c1b on Sunday January 07, 2024 @01:24PM (#38903672)
As someone familiar with the USG data management tech landscape — it’s probably because it’s by far the best product with no remotely close second.
Re:NHS to investigate Palantir influencer campaign as possib... by worik on Sunday January 07, 2024 @01:43PM (#38903894)
> As someone familiar with the USG data management tech landscape — it’s probably because it’s by far the best product with no remotely close second.

That is sweetly naive, unless you are talking about their marketing department

Re:NHS to investigate Palantir influencer campaign as possib... by c1b on Sunday January 07, 2024 @02:01PM (#38904082)
Let me rephrase: I am extremely familiar with the USG data management tech landscape.
Re:NHS to investigate Palantir influencer campaign as possib... by ghc on Sunday January 07, 2024 @02:40PM (#38904435)
I'd love to know (in as much detail as you are allowed) what you feel the strengths and weaknesses of CHEETAS is.
Re:NHS to investigate Palantir influencer campaign as possib... by c1b on Sunday January 07, 2024 @03:29PM (#38904841)
I cannot comment specifically on CHEETAS, but what I can say is that USG developing in house software solutions almost always produces a disastrous product that goes over budget and has extreme maintenance overhead.

To see why, you can simply ask yourself: do you think that the unelected officials overseeing government agencies that embark on enterprise software development projects have sufficient expertise and enterprise software project management experience to be able to do this well?

Furthermore, do you think that the quality of engineers that the NHS or DoD can attract with less than half of the compensation of an actual software company stands a chance at developing something good in house?

It’s unfortunately almost impossible for these projects to go right.

Re:NHS to investigate Palantir influencer campaign as possib... by lmeyerov on Sunday January 07, 2024 @04:17PM (#38905227)
Interesting, thank you for sharing!

That experience speaks more to the perils of in-housing, not to why Palantir is the best COTS for specific needs here. Are there specific leading COTS here you view it so far ahead of for such a contract?

Closer to our own practice.. Modern LLMs have basically reset the field for SOTA in this space, with Palantir, by definition, being behind OpenAI in the most basic tasks, and thus being in the same race as everyone else to retool. Speaking from our own USG experience, we are deep tech leads in some other intelligence areas (graph, ...), and before OpenAI, often chose to adopt prev-gen leading LLM models (BERT, ...) for tasks closer to the NLP side as we recognized that wasn't where our deep tech had an inhouse advantage. We basically had to start over on some of those projects there as soon as GPT4 came out because it just changed so much that the incumbent advantages of already being delivering on a contract were a dead end for core functionality, and almost a year later, it's now obvious that it was the right choice when we get compared to companies that haven't been. Palantir has been publicly resetting as well for using GenAI era tech, which suggests the same situation.

Re:NHS to investigate Palantir influencer campaign as possib... by ethanbond on Sunday January 07, 2024 @07:09PM (#38906596)
It seems like you don’t know what Palantir is. Nothing OpenAI does is competitive with what Palantir does. Palantir, like every other software company out there, is exploring what “my product + AI” means.
Re:NHS to investigate Palantir influencer campaign as possib... by lmeyerov on Sunday January 07, 2024 @07:22PM (#38906674)
Palantir is multiple main things, and a whole ton of custom software projects on top, and a good chunk of them rely on the quality of their NLP & vision systems for being competitive with others. My question relates to the notion that they are inherently the best when, by all public AI benchmarks, they don't make the best components and, in the context of air-gapped / self-hosted government work, don't even have access to them. Separately, I'm curious how they relate to their COTS competitors (vs gov inhouse) given the claims here. For example, their ability to essentially privatize and resell the government's data to itself and make that into a network effects near-monopoly is incredible, but doesn't mean the technology is the best.

I've seen cool things with them, and on the flip side, highly frustrated users who have thrown them out (or are being forbidden to.) It's been a fascinating company to track over the years. I'm asking for any concrete details or comparisons as, so far, there is zero in the claims above, which is more consistent with their successful gov marketing & lobbying efforts than technical competitiveness.

Re:NHS to investigate Palantir influencer campaign as possib... by ethanbond on Sunday January 07, 2024 @11:09PM (#38908160)
I mean the topic of this thread is data management. That’s their bread and butter.

It just doesn’t make sense to be having this conversation through the lens of AI.

Re:NHS to investigate Palantir influencer campaign as possib... by lmeyerov on Monday January 08, 2024 @03:06AM (#38909330)
AI leadership seems existential to being a top data management company and providing top data management capabilities:

* Databricks data management innovations, now that basics are in, are half on the AI side, like adding vector & LLM indexing for any data stored in it, moving their data catalog to be LLM-driven, adding genAI interfaces to accessing data stored in it, ...

* Data pipelines spanning ingestion, correction, wrangling, indexing, integration, and feature & model management, and especially of the tricky unstructured text, photo, and video nature, and wide nature of event/log/transaction recordings important to a lot of the government, are all moving or have already moved to AI. Whether it is monitoring video, investigating satellite photos, mining social media & news, entity resolution & linking on documents & logs, linking datasets, or OCR+translation of foreign documents, these are all about the intelligence tier. Tools like ontology management and knowledge graphs are especially being reset due to the ability of modern LLMs to drastically improve their quality and improve their scalability & usability through automation.

* Data protection has long been layering on AI methods for alerting (UEBA, ...), classification, policy synthesis, configuration management, ...

Databricks is a pretty good example of a company here. They don't preconfigure government datasets on the governments behalf and sell that back to them, but we do see architects using it as a way to build their own data platforms, and especially for AI-era workloads. Likewise, they have grown an ecosystem of data management providers on top vs single-sourcing, eg, it's been cool to see Altana bring supply chain data as basically a Databricks implementation. For core parts, Databricks keeps adding more of the data management stack to their system, such as examining how a high-grade entity resolution pipeline would break down between their stack and ecosystem providers.

Re:NHS to investigate Palantir influencer campaign as possib... by ghc on Monday January 08, 2024 @09:45AM (#38912639)
CHEETAS isn't really developed in house though; it's mainly developed by Dell. Certainly the leadership is USG-associated, but I think the leadership is actually really good. Unfortunately I seem to be unable to get _real_ access to CHEETAS and finding anyone who has worked with it is a challenge.

I suspect underneath it's mostly Hadoop but it's impossible to separate the roadmap from the implementation without getting my hands on it.

Re:NHS to investigate Palantir influencer campaign as possib... by brobinson on Sunday January 07, 2024 @01:49PM (#38903955)
What are the better products that are available?
Re:NHS to investigate Palantir influencer campaign as possib... by cedws on Sunday January 07, 2024 @01:29PM (#38903730)
Which product specifically? As I understand Palantir has several products and the NHS isn't buying one of them but paying for something bespoke.
Re:NHS to investigate Palantir influencer campaign as possib... by SushiHippie on Sunday January 07, 2024 @01:55PM (#38904021)
https://www.palantir.com/uk/healthcare/

They are using palantir foundry, which is palantir's big data platform, or how they call it: "The Ontology-Powered Operating System for the Modern Enterprise"

Re:NHS to investigate Palantir influencer campaign as possib... by ak_111 on Sunday January 07, 2024 @03:47PM (#38904990)
What they call it doesn't sound like legendary marketing that I was expecting.
Re:NHS to investigate Palantir influencer campaign as possib... by SushiHippie on Sunday January 07, 2024 @01:27PM (#38903718)
What would be the second in your opinion, even if it's not close?
Re:NHS to investigate Palantir influencer campaign as possib... by c1b on Sunday January 07, 2024 @02:22PM (#38904265)
It varies by agency — either something built in house (very bad) or built by a company that knows how to acquire government contracts, of which there are few - the set of which frankly always has worse tech than Palantir. If product efficacy is not absolutely critical, the acquisition process will be driven by nepotism or other forms of corruption.

As an example for the second case in DoD space, there’s Advana.