3.5 scored a 1 in bc calc, 4 scored 4 (out of 5)
Because there were large models trained on huge amounts of data yesterday yet they couldn't do it.
Among the general public, doctors and lawyers are high status and magical. An article about how AI will replace them would be more impressive to that public than it creating some obscure proof about the zeroes of the zeta function, even though the latter would be far more indicative of intelligence/scary from an AI safety perspective.
Re:GPT-4
by camjohnson26 on Tuesday March 14, 2023 @02:09PM
(#35155870)
I wouldn’t be at all surprised if an LLM was many times better than a human at math, even devising new axioms and building a complete formal system from scratch would be impressive, but not game changing. These LLMs are very good at dealing with formal, structured systems, but not with in formalized systems like what humans deal with everyday.
Re:GPT-4
by anthonypasq on Tuesday March 14, 2023 @02:25PM
(#35156207)
last i checked a calculator is better at math than all humans ever
They are better at number crunching, which is only a very small part math.
The best doctor knows what's going on in the body. Has a good understanding of human biology at all levels, from molecular reactions to organ interactions. If I could feed test results to the AI and it would tell me what's wrong, that would be amazing. It's almost equivalent to building a simulation of the human body.
Re:GPT-4
by hgomersall on Tuesday March 14, 2023 @03:12PM
(#35156910)
I've joked for a long time that doctors are inference machines with a bedside manner. That bedside manner though is critical. Getting an accurate history and suitably interpolating is a huge part of the job.
"Doctors and Lawyers are glorified databases/search engines at the end of the day" - well, don't be suprised if AI replaces programmers before doctors and lawyers - patients will likely prefer contact with human rather than machines, and lawyers can just lobby for laws which protect their position
And yet the programmers on HN will be yelling they don't need unions as the security guards are dragging them away from their desks at Google, because you know, we'll always need good programmers.
Re:GPT-4
by ren_engineer on Tuesday March 14, 2023 @04:06PM
(#35157605)
if AI gives near equal results for way less cost than people will work around the law to get AI treatment. There are already AI models better at diagnosing cancer than human doctors. I see a future where people send in various samples and an AI is able to correlate a huge number of minor data points to find diseases early
I'll get more concerned if it really starts getting good at math related tasks, which I'm sure will happen in the near future. The government is going to have to take action at some point to make sure the wealth created by productivity gains is somewhat distributed, UBI will almost certainly be a requirement in the future