News for hackers. Stuff that matters.
Re:Citations on the Anthropic API by robwwilliams on Thursday January 23, 2025 @08:02PM (#42809585)
It is definitely not impossible to know. Is there a reason why you or better yet, Anthropic, cannot get empirical FDRs for different areas of research?

In my areas, genetics, neuroscience, geroscience, FDR is below 0.2 on articles in PubMed.

Re:Citations on the Anthropic API by simonw on Thursday January 23, 2025 @10:03PM (#42810108)
Ask Anthropic. I'll be surprised if you can get a straight answer out of them though, like most other labs they are VERY secretive about what actually goes into their training data.
Re:Citations on the Anthropic API by willy_k on Monday February 03, 2025 @11:07AM (#42919610)
You don’t need a straight answer out of anybody. This is an easily verifiable property of the LLM output - are the citations it gives correct, and if so how many?