News for hackers. Stuff that matters.
Re:Accelerating scientific breakthroughs with an AI co-scien... by Nevermark on Wednesday February 19, 2025 @01:15PM (#43105341)
Especially when you consider the artificial impressive high school sophomore is capable of having impressive high school sophomore ideas across and between an incredibly broad spectrum of domains.

And that their generation of impressive high school sophomore ideas is faster, more reliable, communicated better, and can continue 24/7 (given matching collaboration), relative to their bio high school sophomore counterparts.

I don’t believe any natural high school sophomore as impressive on those terms, has ever existed. Not close.

We humans (I include myself) are awful at judging things or people accurately (in even a loose sense) across more than one or two dimensions.

This is especially true when the mix of ability across several dimensions is novel.

(I also think people under estimate the degree that we, as users and “commanders” of AI, bottleneck their potential. I don’t suggest they are ready to operate without us. But that our relative lack of energy, persistence & focus all limit what we get from them in those dimensions, hiding significant value.

We famously do this with each other, so not surprising. But worth keeping in mind when judging limits: whose limits are we really seeing.)

Re:Accelerating scientific breakthroughs with an AI co-scien... by howenterprisey on Wednesday February 19, 2025 @02:42PM (#43106543)
I don't need high school level ideas, though. If people do, that's good for them, but I haven't met any. And if the quality of the ideas is going to improve in future years, that's good too, but also not demonstrated here.
Re:Accelerating scientific breakthroughs with an AI co-scien... by Nevermark on Wednesday February 19, 2025 @03:49PM (#43107458)
I am going to argue that you do. Then I will be interested in your response, if you feel inclined.

We all have our idiosyncratically distributed areas of high intuition, expertise and fluency.

None of us need apprentice level help there, except to delegate something routine.

Lower quality ideas there would just gum things up.

And then we all have vast areas of increasingly lesser familiarity.

I find, that the more we grow our strong areas, the more those areas benefit with as efficient contact as possible with as many more other areas as possible. In both trivial and deeper ways.

The better developer I am, in terms of development skill, tool span, novel problem recognition and solution vision, the more often and valuable I find quick AI tutelage on other topics, trivial or non-trivial.

And the more valuable I find any increase in quality of response. And increasingly even suggestions. Ideas.

High school level familiarity and idea processing on tap, across most public human knowledge is a godsend, vs. what alternative? Less mindful responses?

So sure, you can project the capability vector of these models onto the one dimension of “school level idea quality”. But lower dimension projections are literally shadows of the whole.

Use them in the direction of their total ability vector (and given they can iterate, their ability vector is actually an ability eigenvector!) and their value goes way beyond “a human high schooler”.

Does it make sense to you, to see “high school” here is a floor of contribution ability, not a ceiling? That every additional “school month” of idea level raises the value multiplier on the access and initiative they can provide to everything you don’t already know or even just need reminding of?

It does take time to appreciate & incorporate new tools for what they are.

What do you think?

TLDR; If you know a bright high schooler highly familiar with an area you are not, but have reason to think might be helpful, don’t you think quick access to talk things over with that high schooler would be valuable?

And that a machine incorporating a million high schoolers familiar with a million of your (or my) non-familiar areas isn’t many times more valuable?

Re:Accelerating scientific breakthroughs with an AI co-scien... by the8472 on Wednesday February 19, 2025 @06:43PM (#43109286)
> And if the quality of the ideas is going to improve in future years, that's good too, but also not demonstrated here.

I don't quite understand the argument here. The future hasn't happened yet. What does it mean to demonstrate the future developments now?