News for hackers. Stuff that matters.
Re:Ontology Is Overrated: Categories, Links, and Tags (2005) by AnimalMuppet on Tuesday January 22, 2019 @05:58PM (#18973511)
I'm not sure about that. In Shannon's Information Theory, stuff that aligns with the existing knowledge base contains 0 bits of information. Things that contain new information cannot line up with the existing knowledge base; "news" is exactly the word for such things.

You might be able to say that fake news doesn't align with true facts that aren't part of the facts being reported as news. That is you can tell that "the color of the sky unexpectedly changed from green to yellow yesterday" is fake news, but you can't use true facts to tell that ""the color of the sky unexpectedly changed from blue to yellow yesterday" is fake news. (I mean, yes, you might still use true facts about atmospheric composition, light scattering, and the spectrum of solar output, but you can't use "the sky is blue".)

Re:Ontology Is Overrated: Categories, Links, and Tags (2005) by ChuckMcM on Tuesday January 22, 2019 @06:20PM (#18973795)
I think that is exactly right. So lets say you consider a news story as a 'stream' of bits. And you can demodulate those bits using some formula and there are enough extra bits in the message that you can correct for errors in the channel.

If you get 5 streams of bits and four of them correlate with some epsilon number of new bits, and the fifth has 10x epsilon new bits, one of things is likely true. Either the odd stream out is corrupted or the stream has changed.

Apply that to news stories where the ontology (O) and knowledge graph (KG) are combined to "error correct" the content of the story. "Error bits" would be defined as relationships that don't match what the ontology says can be true, or facts that are different than those facts already in the knowledge base. You can flag the odd news story as lacking alignment with the existing KG&O, further you can quantify that lack of alignment fairly precisely.

So if the news story has 0 bits of information it correlates very strongly with other existing stories. If it has many bits of information it contrasts with other existing stories. At some number of stories on the same topic you can begin to reason about which are more likely 'true' and which are more likely 'false.'

Re:Ontology Is Overrated: Categories, Links, and Tags (2005) by whatshisface on Tuesday January 22, 2019 @07:51PM (#18974599)
Pure contrast isn't enough to hint at falsity, I could tell you a technical detail about what I did today and it would have a 0% overlap with any article on CNN.com. In addition, correlation with your pre-existing beliefs is not sufficient evidence for truth, because today you are wrong about at least a few things. If you look at any given point in history and assume you aren't too special, the first thing you'll realize is that one if not many of the things that are repeated daily in our society are almost certainly false if not outright lies: after all, that claim is true about every other historical period and people group, so why shouldn't it be true about us today?

To suggest a specific example, imagine a person living inside WWII-era Germany correlating a propaganda news article with every other news article they have read, all of which are also propaganda. Correlation-based news epistemology isn't even based on a prevailing social consensus, it's based on the consensus of broadcasters.

Re:Ontology Is Overrated: Categories, Links, and Tags (2005) by AnimalMuppet on Tuesday January 22, 2019 @08:17PM (#18974763)
That is, whoever controls the corpus of "established true facts" controls the determination of whether something is or is not fake news. Which probably gets us to competing corpuses (corpi?) of "established true facts", run by those who push competing meta-narratives. Which looks rather similar to the current situation...
Re:Ontology Is Overrated: Categories, Links, and Tags (2005) by ChuckMcM on Tuesday January 22, 2019 @08:22PM (#18974792)
Exactly so. The operator of the machine gets to control what it is told is 'true' and 'false'. That said, assuming a nominally good actor and an inability to have people process every article, this process provides a means to quantitatively analyze for coherence with your controlled corpus.
Re:Ontology Is Overrated: Categories, Links, and Tags (2005) by whatshisface on Tuesday January 22, 2019 @08:24PM (#18974809)
"Quantitatively analysing the coherence of a controlled corpus," is not exactly a solution to fake news, although it's probably useful for a few other things.
Re:Ontology Is Overrated: Categories, Links, and Tags (2005) by feanaro on Tuesday February 05, 2019 @07:55AM (#19084828)
It certainly helps a lot due to the fact that today you can't be expected to practically sift over all the available information yourself because there's simply too much of it.

If we had a system like this that worked, we could at least leverage it to be able to quantify the coherence of a much larger set of inputs and with many controlled corpora at once.

Re:Ontology Is Overrated: Categories, Links, and Tags (2005) by ChuckMcM on Tuesday January 22, 2019 @08:19PM (#18974774)
I agree with this too, and certainly articles about different topics will have high contrast and low correlation. IBM patented[1] some work we did at Blekko to figure out the topic of a document from its components and that is an essential first step.

It also fails when there are few streams to compare, as when a new story first breaks. Or when there is coordination of actors.

My suggestion is not that it is fail safe or perfect, only that is a useful application of an ontology which disputes the original author's thesis that they are overrated.

[1] https://patents.google.com/patent/US10157178B2/

Re:Ontology Is Overrated: Categories, Links, and Tags (2005) by whatshisface on Tuesday January 22, 2019 @08:29PM (#18974845)
>It also fails when there are few streams to compare, as when a new story first breaks. Or when there is coordination of actors.

All of these things are hallmarks of fake news: it is claimed to be new (hence "news",) is not published very widely (you can't compare a aquariusrising.biz article on Green Space Aliens to a CNN article on the same, because there isn't a CNN article on that), and it's usually coordinated between copycat opportunists. Even worse, none of these things are distinguishable from a grassroots report unless you know the true news a-priori. This better not be a mechanism to ban everything that isn't on CNN.com.