During the industrialization, machines did not replace all jobs, but they replaced or changed most jobs. The same will happen here.
A typical office job will have a few hours a week of actual, intensive thought. The vast majority of time will be spent doing simple, repetitive work. This work can be automated, or at least significantly sped up, using technology like GPT.
“write an API client for …”, “integrate APIs … and …” can easily be automated. Yes, you'll still have to write the business logic, but that's not the majority of your work today. You could even have it write unit tests based on the JIRA ticket description.
The same applies to many other jobs.
This is a wonderful point: writing unit tests is exactly the kind of mind-numbing tedium that I'm super excited to automate away.
GPT can be of use there, as long as you're working with languages that use strict static types and have proper tests, it's easy to automate and ensure there are no mistakes.
Like the point above; that says more about the work.
It’s going to be really interesting how the middle-class narrative pushes back on AI revealing how little work is actually done during office hours.
Is this true even if you tell it to show its working? In my experience that drastically improves its ability to do math problems.
Answer: To solve this equation, we can use the quadratic formula:
x = (-b +/- sqrt(b^2 - 4ac)) / (2a)
Plugging in the values for a, b, and c, we get:
x = (-11 +/- sqrt(11^2 - 4130)) / (2*1)
x = (-11 +/- sqrt(121 - 120)) / 2
x = (-11 +/- sqrt(1)) / 2
x = (-11 +/- 1) / 2
x = -5 or x = -6
So the solutions to the equation are x = -5 and x = -6.
Which means whatever apparent logic you're getting out of it is from text that it has learned. not reasoning embedded within those text, but the actual text itself.
The radiology AIs are technically more accurate than radiologists on any sufficiently large dataset, and yet they still have not replaced radiologists (or even are anywhere close to).
Humans are bad at reciting things, but a lot better (compared to GPT) at reasoning.
It doesn’t matter to me if they have “reasoning” capabilities or not if the outcome is the same.
I think we are a long ways off from AGI still.
Which tasks? The output of some crafter with a limited number of modules, and of somebody who can assess the output, cannot be the same - unless you would have accepted the output of a mentally crippled entity in the first place.
* Understanding complex language does not require logic/reasoning,
* There are infinitely many forms of logic/reasoning or at least more than those existing in a vast training set.
Neither of which is likely true.
What do you think of the Minerva system, which can solve multi-step quantitative reasoning questions better than many competent students and most adults?
https://ai.googleblog.com/2022/06/minerva-solving-quantitati...
Note: If you look at LSAT test samples, many questions are tests of complex logical reasoning, a requisite for legal professions.
I also really strongly disagree that it’s basically doing some sort of information retrieval design where based on language it regurgitates some sort of markov expectations. You can ask it to do very complex translations of a concept from one domain to another and expressed in a form that’s certainly never been done before and it does it with alacrity. At the very minimum it “remembers” things from the past in the conversation and can associate the semantic ideas across prompts and synthesize cogent responses - that in itself implies it has some semantic “understanding” of the structure of the language. That is a huge missing piece in our tool kit to date.
Frankly I feel these threads expose just how jaded and unable to dream we have become, that even when a wonder walks up and hits you in the nose we can’t even see it.
There are no magic, it is just a more complicated transpose, created by training over perhaps 10% of all available text on the internet.
It does have a lot of use, for one I think it would probably put grammarly out of business, and maybe even do some work for law firms.
Src: scored 99.8th percentile on LSAT, tutored it, now working at major law firm
The key is understanding. It does not need to, it has already seen the question asked in a 100 different ways, it also seen the answer to all of those. It just rephrases those answer via a neural network and that happen to pass the bar test.
> There are infinitely many forms of logic/reasoning or at least more than those existing in a vast training set.
More importantly, differences between forms are subtle and cannot be understood, that's why ChatGPT confidently give wrong answers on stackoverflow: https://meta.stackoverflow.com/questions/421831/temporary-po...
Yes, it doesn't have reasoning ability, but being able to manage knowledge and information in the way that these models can is still an amazing feat.
Gun to my head where I had to put money down, I would put it on "Brains are not nearly as special as we (they?) think they are." No fairy dust or supernatural beings required, brains are just another AI model (and likely not even a particularly great one).
As long as it comes across some reasoning process that have not been seen before in the training wordset, which can be as easy as a middle school math question, it fails. Because it has no ability to extrapolate logic.
If it manages to pass Bar test, that says more about the Bar test than it says about GPT.