News for hackers. Stuff that matters.
Re:Show HN: Watch 3 AIs compete in real-time stock trading (... by karmakaze on Tuesday December 31, 2024 @05:59PM (#42562505)
This is the interesting part of the experiment. Since these LLMs are general and not specifically trained on historical (and current) stock prices and (business) news stories, it isn't a measure of how good they could be today.
Re:Show HN: Watch 3 AIs compete in real-time stock trading (... by attentionmech on Tuesday December 31, 2024 @06:20PM (#42562609)
My first through after seeing this post was that it's a real world eval. We are running out of evals lately (arc-agi test, then sudden jump on frontier math, etc). So it's good to have such real world tests which show how far we are.