I'm acutely aware of ChatGPT's mistakes, have spent lots of time investigating them, and still find immense value in the tool.
While it's true that many less technical people will end up treating it as an oracle, let's not conclude that it's impossible to understand what it is and use it productively despite its flaws.
There is nothing I find more fatiguing than pushing a bubble around underneath a rug in a system that eventually has to be carefully taken and inspected bit by bot and a huge amount of work put into figuring out what exactly is wrong with it and fixing it.
I’m afraid the ChatGPT enthusiast is going to walk away from a looming disaster thinking they and ChaptGPT is so brilliant, probably never realize the harm they did, and if they do they’ll be contemptuous of the low-status ‘grinds’ who take so long to make things right.
Couldn't agree more
> I’m afraid the ChatGPT enthusiast is going to walk away from a looming disaster thinking they and ChaptGPT is so brilliant
Also agree.
But none of this detracts from ChatGPT's value or incredible power.
It just means that it will also cause many problems. Maybe once you net everything out the balance sheet is negative. I think you could make that argument for social media, for example. But the point is moot, because it's here, and its influence is only beginning.
Agreed; it quickly became apparent once I found myself entering the 'seeing its rough edges' camp.
Once you've _tried_ breaking it and can see the limits of an LLM you'll find yourself wishing for an AI assistant, but knowing what is and isn't possible makes managing one's expectations with new technologies easier.
I'm still generally an optimist with these new techs because they're still very cool and potentially useful interfaces to existing technologies, but I agree with you in that it's too easy to get caught up deferring to it like it's some techie oracle (and that the tendency for people to want to do so is concerning).
I used to think people wouldn't "simply accept" the types of systems in _Minority Report_ or _Psycho-pass_, to the extent that I found it to be immersion-breaking. But, concerningly, it seems folks are happy and willing to give up that deference (in what's probably a well-studied sociological observation I'm simply unaware of the term for). Scary stuff.
He was not amused.
But the idea that it's a fraud or a scam or whatever label the naysayers choose to put on it is just wrong. It makes mistakes, but it also provides a lot of value when used correctly.
Consider the many use cases where you don't need to rely on its "knowledge" at all - just this morning, I used it to write some marketing emails. I've got a paragraph about the company that I give it, plus some specifics about the particular email, and it knocks out something that's entirely useable in seconds.
There are plenty of tasks like this, in which it's creating something based on your input, in which it is immediately and clearly useful. Just because there are use cases where it fails doesn't make it a scam.
Why would that be the case if people didn't consider them valuable?
Is there any evidence of the existence of scams which deliberate use poor grammar to filter respondents?
If I was a scam artist today I would be very happy to find people of the second kind to victimize.
Secondly I’d be very concerned that the second kind of person is working at the hospital dispensing drugs or on the beat as a cop or doing any kind of job where mistakes could have consequences. They're not just going to be making mistakes and letting other people's mistakes go by, they are going to be denying it and making excuses about it.
If ChatGPT has a core competence it is that people give it the deference that they give to high status people, who are used to just saying whatever comes into their head and having people just nod. I think of the story of “the Emperor’s new clothes” where the Emperor pulls off something that not everybody could do.
These concerns converge in the 419 scams which deliberately filter for the second kind of person with deliberately poor grammar and spelling. Amazingly there are people who have $10 million dollars to lose who fall for this! I wonder if there is somebody evil, bright, hard-working and ambitious who is HFRL training a model right now to do romance scams.