News for hackers. Stuff that matters.
Re:ResearchAgent: Iterative Research Idea Generation Using LLMs by ethanwillis on Monday April 15, 2024 @09:41PM (#40047584)
If we keep extrapolating eventually GPT will be omniscient. I really can't think of any reason why that wouldn't be the case, given the exponential curve we find ourselves on.
Re:ResearchAgent: Iterative Research Idea Generation Using LLMs by esafak on Monday April 15, 2024 @10:08PM (#40047721)
How do you know you're not on a logistic curve?

Don't you think costs and the availability of training data might impose some constraints?

Re:ResearchAgent: Iterative Research Idea Generation Using LLMs by dragonwriter on Monday April 15, 2024 @10:41PM (#40047879)
With real world phenomena that have resource constraints anywhere, a good rule of thumb is: if it looks like an exponential curve, walks like an exponential curve, and quacks like an exponential curve, it’s definitely a logistic curve
Re:ResearchAgent: Iterative Research Idea Generation Using LLMs by HeatrayEnjoyer on Tuesday April 16, 2024 @11:26AM (#40053237)
The entire universe is training data.
Re:ResearchAgent: Iterative Research Idea Generation Using LLMs by esafak on Tuesday April 16, 2024 @01:21PM (#40054687)
It is, but we -- humans, and computers -- are limited in our ability to learn from it. We both learn more easily from structured data, like textbooks.
Re:ResearchAgent: Iterative Research Idea Generation Using LLMs by inference-lord on Monday April 15, 2024 @11:24PM (#40048081)
I think they're being factitious?
Re:ResearchAgent: Iterative Research Idea Generation Using LLMs by ethanwillis on Tuesday April 16, 2024 @03:08AM (#40049139)
I am. And I think it says a lot about the state of things that many people think I'm being completely serious.
Re:ResearchAgent: Iterative Research Idea Generation Using LLMs by fire_lake on Tuesday April 16, 2024 @01:15AM (#40048594)
This has the form of a religious belief.
Re:ResearchAgent: Iterative Research Idea Generation Using LLMs by mistermann on Tuesday April 16, 2024 @01:54AM (#40048764)
And also non-religious belief...paradoxical!