AI tools are spotting errors in research papers: inside a growing movement

Re:AI tools are spotting errors in research papers: inside a... by surferbayarea on Saturday March 08, 2025 @12:46PM (#43301918)

Here are 2 examples from the Black Spatula project where we were able to detect major errors: - https://github.com/The-Black-Spatula-Project/black-spatula-p... - https://github.com/The-Black-Spatula-Project/black-spatula-p...

Some things to note : this didn't even require a complex multi-agent pipeline. A single shot prompting was able to detect these errors.

[ Parent | on HN ]

Re:AI tools are spotting errors in research papers: inside a... by fph on Sunday March 09, 2025 @12:25PM (#43310639)

This black spatula case was pretty famous and was all over the internet. Is it possible that the AI is merely detecting something that was already in its training data?

[ Parent | on HN ]

Re:AI tools are spotting errors in research papers: inside a... by surferbayarea on Wednesday March 12, 2025 @12:32AM (#43339973)

This is the original work that detected the problem.

[ Parent | on HN ]

Re:AI tools are spotting errors in research papers: inside a... by fph on Friday March 14, 2025 @04:33PM (#43366995)

I found many sources on the internet that state that the error in the black spatula paper was discovered by John Schwarcz of McGill University while reviewing a research paper:

[1] https://www.expatgo.com/my/2024/12/15/an-error-in-arithmetic... [2] https://gizmodo.com/embarrassing-math-error-scared-the-pants...

Is John Schwarcz behind this Yesnoerror or the black spatula project?

[ Parent | on HN ]