News for hackers. Stuff that matters.
Re:AI for Scientific Search by gavinray on Thursday July 03, 2025 @01:14PM (#44457195)
I was hoping for this to announce a tool for research.

Anyone know of the best way to do something like:

"Find most relevant papers related to topic XYZ, download them, extract metadata, generate big-picture summary and entity-relationship graph"?

Having a nice workflow for this would be the best thing since sliced bread for hobbyists interested in niche science topics.

Recently found https://minicule.com which is free and lets you search + import, but it focuses more on "concept-extraction" than LLM synthesis/summary.

Re:AI for Scientific Search by andjar on Thursday July 03, 2025 @03:22PM (#44458348)
A while ago, I started working on two R packages for creating 'living reviews': metawoRld and DataFindR, see https://andjar.github.io/metawoRld/articles/conceptual_overv... . You do the broad literature search yourself, but the idea is to use LLMs to select relevant studies and perform data extraction in a structured, reproducible manner. The extracted data is stored in a git repository for collaboration and version tracking, with automated validation and website generation for presenting results.
Re:AI for Scientific Search by TechDebtDevin on Thursday July 03, 2025 @03:55PM (#44458634)
"Structured and Reproducable"
Re:AI for Scientific Search by hugeBirb on Thursday July 03, 2025 @02:18PM (#44457795)
I've been trying to tackle this exact problem. Current process is to use exa.ai to collect a wide breadth of research papers. Do a summarization pass and convert to markdown. Search for more specific terms then give the relevant papers/context to Gemini 2.5 pro and say give me a summary. Looking for very specific resources and to be honest it's been a terrible process :|
Re:AI for Scientific Search by kianN on Thursday July 03, 2025 @03:21PM (#44458340)
Linking to a nearby thread in case this is helpful: https://news.ycombinator.com/item?id=44457928
Re:AI for Scientific Search by AustinBGibbons on Thursday July 03, 2025 @01:26PM (#44457305)
Re:AI for Scientific Search by gavinray on Thursday July 03, 2025 @03:08PM (#44458243)
Seems potentially useful, thanks! Only drawback I can see is the small number of papers provided by the free plan, but that's reasonable I suppose.
Re:AI for Scientific Search by tkuipers on Thursday July 03, 2025 @03:23PM (#44458353)
I’ve found a lot of success with https://www.undermind.ai/ though I’m not sure it has the graph you’re looking for
Re:AI for Scientific Search by gavinray on Thursday July 03, 2025 @03:40PM (#44458490)
This also looks excellent, thank you!
Re:AI for Scientific Search by whattheheckheck on Thursday July 03, 2025 @03:51PM (#44458594)
Connectedpapers.com
Re:AI for Scientific Search by kianN on Thursday July 03, 2025 @02:32PM (#44457928)
I built a public literature review search tool for some graduate student friends that became pretty popular in the Santa Barbara area. It actually does exactly what you are describing.

It’s not neural network based: it leverages hierarchical mixture models to give a statistical overview of the data. It lets you build these analysis graphs via search or citation networks.

Example: https://platform.sturdystatistics.com/deepdive?search_type=e...

Re:AI for Scientific Search by gavinray on Thursday July 03, 2025 @03:07PM (#44458234)
This is genuinely incredible, tried it using a recent-ish paper on the pharmacology and mechanisms of the Androgen Receptor and my mind is blown:

https://platform.sturdystatistics.com/deepdive?fast=1&q=http...

Re:AI for Scientific Search by dmezzetti on Thursday July 03, 2025 @02:18PM (#44457797)
PaperAI is also an option if you prefer open-source: https://github.com/neuml/paperai

Disclaimer: I'm the primary author of this project.

Re:AI for Scientific Search by tough on Thursday July 03, 2025 @07:50PM (#44460075)
emergentmind is pretty good
Re:AI for Scientific Search by sergeim19 on Thursday July 03, 2025 @07:58PM (#44460109)
Hi, I'm the creator of https://tatevlab.com. It does something similar + aiming to be something like a "spotify" for research papers (currently working on a feature to allow creating and sharing personal collections). It summarized papers based on practical potential and you can find papers based on similarity. Feedback is welcome.
Re:AI for Scientific Search by Metacelsus on Thursday July 03, 2025 @11:05PM (#44460822)
Re:AI for Scientific Search by gavinray on Friday July 04, 2025 @10:03AM (#44464678)
Their Chemistry LLM that's an iteration of ChemCrow is really useful, thank you!
Re:AI for Scientific Search by matt1 on Tuesday July 08, 2025 @05:48PM (#44504358)
My site, https://www.emergentmind.com, is exactly for this. It surfaces trending AI/ML/CS papers, summarizes them, links to social commentary, lets you read and download papers, links to topics, and more. Would love any feedback you have!