News for hackers. Stuff that matters.
Re:Meta is building an AI to fact-check Wikipedia by oarabbus_ on Friday August 26, 2022 @11:28PM (#32615352)
Many of the comments in this thread seem to not have anything to do with the content of the article, or the researchers' blog post cited within the article. There also seem to be some mistaken assumptions about the purpose of this AI.

Here is what the model is actually (attempting) to do:

>It calls attention to questionable citations, allowing human editors to evaluate the cases most likely to be flawed without having to sift through thousands of properly cited statements. If a citation seems irrelevant, our model will suggest a more applicable source, even pointing to the specific passage that supports the claim. Eventually, our goal is to build a platform to help Wikipedia editors systematically spot citation issues and quickly fix the citation or correct the content of the corresponding article at scale.

Re:Meta is building an AI to fact-check Wikipedia by notahacker on Saturday August 27, 2022 @05:45AM (#32617370)
This.

Even a pretty poor model (and it probably will be) would be a huge boon to editors in an encyclopedia full of references which are missing, out of date, a bit stretchy or plain bad faith. Wikipedia already has bots on it doing grunt work, and plenty of editors that like doing grunt work of checking minor details more than writing new content.

Re:Meta is building an AI to fact-check Wikipedia by visarga on Saturday August 27, 2022 @08:03AM (#32618056)
It's just one of the low hanging AI fruits we can pick now, nothing unexpected.

We're doing similar things to find errors in our regular ML datasets - a large proportion of the examples the model can't predict are mislabeled. Those mislabeled examples have a big penalty on performance. Since Wikipedia is often used in ML, it was time to clean it up.

Re:Meta is building an AI to fact-check Wikipedia by tmaly on Saturday August 27, 2022 @12:43AM (#32615782)
If the citations are to really old out of print books, how can it tell what is true and what is not?
Re:Meta is building an AI to fact-check Wikipedia by oarabbus_ on Saturday August 27, 2022 @01:07AM (#32615922)
The article states the training set included 134 million only webpage/URL citations.

Since it is open-source, I'd imagine some researchers with computer vision expertise and skilled with document/text digitization could greatly enhance this AI by digitizing these old books and including them in the training.

Re:Meta is building an AI to fact-check Wikipedia by IIAOPSW on Saturday August 27, 2022 @01:22AM (#32615987)
You know how when you click a link and find that its a PDF you suddenly trust it as credible science. The AI is going to learn some superficial-yet-amusingly-accurate heuristic similar to that.
Re:Meta is building an AI to fact-check Wikipedia by Fatnino on Sunday August 28, 2022 @02:30AM (#32626268)
You what now?

PDFs are a pain in the ass to read, especially on mobile

Re:Meta is building an AI to fact-check Wikipedia by charcircuit on Saturday August 27, 2022 @01:02AM (#32615892)
They admit in the research paper that the AI is only for references to web pages for articles written in English.

You can't use it to verify citations to books.

Edit: To clarify it could replace a citation to a book with a web page assuming that information exists on the internet.

Re:Meta is building an AI to fact-check Wikipedia by tux3 on Saturday August 27, 2022 @01:05AM (#32615909)
Plugging it into your local libgen/scihub equivalent is left as an exercise to the reader

Nothing that can't be done in principle, just hard/tedious engineering

Re:Meta is building an AI to fact-check Wikipedia by jpalomaki on Saturday August 27, 2022 @03:46AM (#32616779)
If this approach works, Google could help. They scanned lots of books [1].

[1] https://en.wikipedia.org/wiki/Google_Books

Re:Meta is building an AI to fact-check Wikipedia by sebastianconcpt on Saturday August 27, 2022 @07:38AM (#32617916)
Nothing non-digitally readable, editable and re-writable will count as input for the AI
Re:Meta is building an AI to fact-check Wikipedia by sebastianconcpt on Monday August 29, 2022 @08:09AM (#32637204)
With this, I also mean, let's better blockchain immutably the classics if we want humanity to have any defense of History from being re-written.
Re:Meta is building an AI to fact-check Wikipedia by netsharc on Saturday August 27, 2022 @03:44AM (#32616771)
There was a IIRC German politician who was part of a prank involving Wikipedia, someone claimed in his Wikipedia article that he had 200+ names. Lazy news writers quoted the Wikipedia article as a "fun fact" segment, and the Wikipedia article then turned around and said "here's an authoritative source on that 200+ names..."
Re:Meta is building an AI to fact-check Wikipedia by nnamtr on Saturday August 27, 2022 @03:56AM (#32616824)
Not 200, like 10. Someone added a false one, and it found its way to serious websites. German source: https://bildblog.de/5704/wie-ich-freiherr-von-guttenberg-zu-...
Re:Meta is building an AI to fact-check Wikipedia by MauranKilom on Saturday August 27, 2022 @05:42AM (#32617358)
Re:Meta is building an AI to fact-check Wikipedia by PoignardAzur on Saturday August 27, 2022 @04:16AM (#32616943)
> Many of the comments in this thread seem to not have anything to do with the content of the article, or the researchers' blog post cited within the article.

I know, right? The halo effect is strong in this thread.

Re:Meta is building an AI to fact-check Wikipedia by wutbrodo on Saturday August 27, 2022 @10:52AM (#32619673)
HN on FAANG-related threads may as well be a default sub on Reddit. Practically guaranteed to get a heaping dose of childish, manic hysteria instead of a basic understanding of the article's content.

Ive got no love for FB or "fact-checking", but I knew much of this thread would be a dumpster fire.

Re:Meta is building an AI to fact-check Wikipedia by bell-cot on Saturday August 27, 2022 @09:25AM (#32618684)
By very amusing coincidence, one of my favorite YouTube subject matter experts posted a video on this exact problem (questionable citations) less than 24 hour ago - https://www.youtube.com/watch?v=_1HwANCSJMU

(The video's context is the sinking of the German battleship Bismark. Whether or not you've any interest in that subject, the video can still give you a far better sense of the problem than Singularly Hub's article.)

Re:Meta is building an AI to fact-check Wikipedia by porker on Saturday August 27, 2022 @07:48AM (#32617961)
I would like this to be available as a search engine too, so I can input an idea and get relevant citations for it. This would help explore prior work in any field.
Re:Meta is building an AI to fact-check Wikipedia by ahmadmijot on Saturday August 27, 2022 @08:00AM (#32618033)
Wow, I wonder if this can also be applied to academic papers. Not for detecting plagiarism (there are already tools for that), but for 'improper' (?) citation
Re:Meta is building an AI to fact-check Wikipedia by euroderf on Saturday August 27, 2022 @10:47AM (#32619600)
Facebook Footnote Systemization (FFS)
Re:Meta is building an AI to fact-check Wikipedia by sebow on Saturday August 27, 2022 @03:42AM (#32616758)
> allowing human editors

Ah, the renowned human editors/fact-checkers/moderators that Facebook employs, great.