Re:What happens when you analyze your favorite college footb...
by ungreased0675 on Friday September 25, 2026 @07:10PM
(#49851228)
It seems very likely then that the results are hallucinations. You can’t prompt an LLM to follow a certain analytic methodology, it can’t.
But, it can simulate the output of a methodology, which is not the same thing.
Re:What happens when you analyze your favorite college footb...
by toyg on Friday September 25, 2026 @08:13PM
(#49851792)
I think this comment encapsulates the fundamental state of AI at the moment.
The industry believes very strongly that this simulation of methodology is basically as good as the real thing (or at least "good enough" in most cases).
This belief is the fault line between the bullish and the bearish; it requires a leap of faith that not everyone is willing or capable of taking.
Re:What happens when you analyze your favorite college footb...
by adam on Friday September 25, 2026 @09:13PM
(#49852140)
Every forecast question we ask has a verifiable outcome. We then score it based on what actually happens in reality and create a track record for all of it. In typical analysis, nothing is scored, and no one goes back and checks if it was right or wrong, but we do - whether we're scoring humans in human forecasting exercises, or seeing how AI does.
You're right that a human analyst - especially a very experienced one - is going to be able to still do a better job of analysis most of the time, but the AI is useful for having loops to re-examine the question, consume and curate new information, etc. We've built the system with that assumption: let humans do what they're best at, let AI do what it's best at...