Isn't that the point? Looking through the pep rally excitement of Nadella saying "I'm going to make Google dance" and looking at the actual product.
Honestly some of the Bing results[1] have me thinking that maybe LLMs are ready for Clippy and Copilot style products, and then maybe a browser extension that summarizes pages, but a generally available search launch has a high chance of Bing memeing themselves (again).
[1] beyond just errors: https://twitter.com/MovingToTheSun/status/162515657520253747...
The actual wide narrative is that the current language models hallucinate and lie, and there is no coherent plan to avoid this. Google? Microsoft? This is a much less important question than whether or not anyone is going to push this party-trick level technology onto a largely unsuspecting public.
It’s also very tempting when you get coherent text out to believe it. Hopefully the underlying tech will get better and/or people will understand it’s weaknesses… except the inability to ascertain clear misinformation gives me pause.
“Create a summary of this itinerary in an email that I can send to my family”
“65-inch TV” -> refine with “Which is the best for gaming?”
Seems like more than a fact-finding engine.
Over the weekend, I was shopping for laptops and tried searching "laptops AMD GPU at least 2560x1440 resolution at least 16 GB RAM", and of course Google gave all sorts of results that didn't fit those criteria. I could use quotes around "16 GB RAM", but then some useful results might get excluded (e.g. a table with "RAM" or even "Memory" in one column and "16 GB" in another, or a laptop with a higher resolution like 4K), and I'd still get many incorrect results (e.g. an Amazon page for a laptop with 1920x1080 resolution and then a different laptop in "similar options" with 2560x1440 resolution but an Nvidia GPU). I decided to try using ChatGPT to list me some laptops with those criteria; it immediately listed five correct models. I asked for five more, and it gave one correct option and four incorrect ones, but when I pointed out the mistakes and asked for 10 more results that did fit my criteria, it was able to correctly do this. Because I can easily verify externally if a given laptop fits my criteria or not, I'm not at risk of acting on false information. The only limitation is that ChatGPT currently won't search the internet and has data limited to 2021 and earlier. If it had access to current data, I think there would be a lot of places that it would be useful, especially given that it wouldn't necessarily replace existing search engines, but complement them.
A pure LLM approach is going to quickly lose its novelty as reprompting is frustrating and it is difficult to maintain a long lived conversation context that actually 'learns' how to interact with the user (as a person would).
So do people. And ChatGPT is a whole lot smarter than most people I know. It's funny that we've blown the Turing test out of the water at this point, and people are still claiming it's not enough.
At the time, it was inconceivable that a program could interact the way that ChatGPT does (or the way that Dall-E does) without AGI. We now know that this is not the case, and that means that it might finally be time to recognize that the Turing test, while a brilliant idea at the time, doesn't actually differentiate in the way that we want to.
70 years without moving the goal posts is, frankly, pretty good.
Logic arguments and geometric analogies were once considered the epitome of human thinking. They were the first to fall. Computer vision, expert systems, complex robotic systems, and automated planning and scheduling were all Turing-hard problems at some point. Even Turing thought that Chess was a domain which required human intellect to master, until DeepMind. Then it was assumed Go would be different. Even in the realm of chat bots, Eliza successfully passed the Turing test when it was first released. Most people who interacted with it could not believe that there was a simple algorithm underlying its behavior.
Not just one professor you worked with, this has been a common observation across the field for decades.
But the deeper debate about this is absolutely not about moving goal posts, it is about research revealing that our intuitions were (and thus likely still are) wrong. People thought that very conscious, high-cognition tasks like playing chess likely represented the high water mark of "intelligence". They turned out to be wrong. Ditto for other similar tasks.
There have been people in the AI field as long as I've been reading pop-sci articles and books about who have cautioned about these sorts of beliefs, but they've generally been ignored in favor of "<new approach> will get us to AGI!". It didn't happen for "expert systems", it didn't happen for the first round of neural nets, it didn't happen for the game playing systems, it didn't happen for the schedulers and route creators.
The critical thing that has been absent from all the high-achieving approaches to AI (or some subset of it) thus far is that the systems do not have a generalized capacity for learning (both cognitive learning and proprioceptive learning). We've been able to build systems that are extremely good at a task; we have failed (thus far) at building systems which start out with limited abilities and grow (exponentially, if you want to compare it with humans and other animals) from there. Some left-field AI folks would also say that the lack of embodiment hampers progress towards AGI, because actual human/animal intelligence is almost always situated in a physical context, and that for humans in particular, we manipulate that context ahead of time to alter the cognitive demands we will face.
Also, most people do not accept that Eliza passed the Turing test. The program was a good model of a Rogerian psychotherapist, but could not engage in generalized conversation (without sounding like a relentlessly monofocal Rogerian psychotherapist, to a degree that was obviously non-human). The program did "fool" people into feeling that they were talking to a person, but in a highly constrained context, which violates the premise of the Turing test.
Anyway, as is clear, I don't think that we've moved the goal posts. It's just that some hyperactive boys (and they've nearly all been boys) got over-excited about computer systems capable doing frontal lobe tasks and forgot about the overall goal (which might be OK, if they did not make such outlandish claims).
But humans do so much more than that, as the other reply indicates.
ChatGPT is good at generating text that sounds smart. It is not smarter than most people you know.
You and I live in a rarefied world. It's far better at writing than most people I know. and i suspect it's (sadly) better at logic/ math than many people, which, i fully admit isn't saying much.
Yes, not all questions have definitive answers, which is fine, then you can argue that they are better then going to the smartest human you know and that might be enough. Although I personally would still disagree with this argument, since I think it's better that the answer provided is "I don't know".
It's no better for other domains either. It can give programming advice, but it's often wrong in important ways and so no, I'd rather have the answer verified by an actual developer who knows whatever technology I'm asking about.
And finally, when you talk about what is "enough", I'd ask "for what?" This is what people in this thread are saying. That ChatGPT is not enough for the majority of what people wish it to be, but it may be enough for some tasks such as a creative writing aid or other human in the loop tasks.
most important while both AIs get sometimes very important and fundamental things wrong they do get enough right to be of help in some tasks to be of a lot of help
that's only true if you can easily and cheaply identify when they are correct. But at this time, and for the foreseeable future, that's not the case.
also you can't just use this tech to "get the truth" but to generate things in which it sometimes is rather simple to identify and fix mistakes, and where due to human error you anyway have a "identity and fix mistakes step"
have most of this kind of usages likely negative impact on society? Sure. But for adoption that doesn't matter because "negative impact on society" doesn't the main adopters money, or at least not more then they make from it
I said it will happen because you can make/save money with it.
And it's not just big cooperation, it's already good enough for many applications of all kinds and sizes of companies to be used from a financial point of view.
And "it makes money so people will do it" is a truth we have to live with as long as we don't fundamentally overhaul our economic system.
Search is one application, and it might be crap right now, but for Microsoft it only needs to provide incremental value, for Google it's life or death. Microsoft is still better positioned in both the enterprise (Azure, Office365, Teams) and developer (Github, VSCode) markets.
The issue involved heavy numerical computation with numpy, and it found a library call for that that covered exactly my issue.
But I find it also hallucinates in code, coming up with function calls that aren't in the API but would sound like a natural thing to call.
Overall it's a positive though, it's pretty easy to tell for your other coding tools if the suggestion is for something made up, and the benefits of filling in your next little thought are very real.
In fact, it was the glut of SEO nonsense like keyword stuffing is that PageRank countered.
If Google search sucks, someone will make one that doesn’t suck, and people will switch.
these tools are incredible productivity boosts if you leverage them well.
here's a sample from gpt: a low effort question and a code dump that would get you flamed on stackoverflow.
https://cdn.discordapp.com/attachments/263091858505334784/10...
I love it. As long as we continue to use these tools as augmentive, it's just going to get better and better
It's Microsoft's own advertisement.
https://www.youtube.com/watch?v=0QEDBEdL7HY
They even have a far more advanced language model, they just don't release it publicly. It's scary how far Google is ahead, with its army of Ph. D's. They're the ones that pioneered the papers and techniques that OpenAI used -- but they did it 5 years ago.
This is just Google being Google ... they sunsetted Reader when it was popular, went through like 20 different chat products (GMail Chat, Hangouts, Google Meet, etc. etc.) and cannibalized their own projects. But as far as technology, they've got AI they're not disclosing to the world yet.
Having PhDs or doing research does not equal the ability to create products people want to use and/or pay for. History has shown us time and time again there are some people who are amazing at creating original and groundbreaking research and other people who are amazing at turning research into money making, people-pleasing products. See all the research that came out of Xerox PARC which ended up doing nothing for Xerox and everything for Apple (and other companies).
Google has been spending a fortune on research in AI for 15+ years and, if anything, the company's main product (Search) has only gotten worse! They have been second, third best, or moribund in mobile phones, cloud computing, videogames, social media, and many others I've forgotten.
Now I'm not sure what the moral of the story here is but I can say it definitely isn't that doing the most research equals success because it clearly isn't that! I'd say it's probably a culture issue and also a motivation issue (which are clearly related). You're sitting on a money printing machine, employees all earning 350k+ per year, in an office filled with bean-bags, gourmet food, and living a chill life with nice and comfortable working hours... where is the motivation and drive to try and build a really innovative and amazing new product? "Sounds like a lot of work man..." It surprises me little that OpenAI beat them to the punch.
There's a lesson for founders in this. If you develop in secret and try to launch a perfect product then anything less that perfect is unforgivable. If you launch early with something that has obvious problems people will forgive them because they see the potential and trust you to fix them.
That seems very optimistic to me. Having seen Siri, Google Assistant, Cortana, and Alexa I trust that changes will be made, some of them will even be positive, but generally a net negative until they are completely irrelevant.
Notice how neither of these announcements mention their digital assistants getting an upgrade to be less garbage.
It’s not a perfect mitigation, but surely it’s at least one step above “no plan”.
Second, if I give you a wonderfully written paragraph or two about the history of the British Parliament, and 3 links that supposedly back me up, how likely are you to check the links? Because that's what is actually going to happen. The LM will not "cite" a source, it will provide one out-of-band and your motivation to read it will need to be high, which is unlikely given the apparent quality of the LM's own answer.
It’s ironic that you’re very confidently presenting erroneous information here. I’d really recommend trying the actual product, or at least looking at the demos. It has some problems. It does not have the same problems that chatgpt does, because it does not rely solely on LLM baked-in data.
The actual wide narrative is this: yes the models lie and hallucinate, but people are realizing now that this is essentially what every human AND website currently does now! Every human presents their "facts" and "viewpoints" as though they know the whole truth but really they are just parroting whatever talking points they got from BBC or TheGuardian or Fox News, and all of those journalists are just using other sources with their own biases and inaccuracies. Basically, it's bullshit and inaccuracies all the way down!
I was chatting with my friends when out for dinner last night about ChatGPT and we concluded that while it does have inaccuracies, it's still better than asking humans for information and still better then the average Google SEO-Spam website. That is, what makes us think random human made website about say space travel is more or less accurate than ChatGPT or what our friend Bob thinks about space travel.
The truth is, most of the information we receive on a daily basis is inaccurate or hallucinated to some degree, we just have gotten "used" to taking whatever the BBC or Bloomberg or ArsTechnica says as "the truth."
You can rationalize what people are saying based on their experiences, opinions, and backgrounds. You can engage in the Socratic method with people, to unpack where their claims come from and get to the grounding "truth" of primary experience.
You can't do any of these things with ChatGPT, because ChatGPT isn't grounded – it goes in circles at a level of abstraction where truth doesn't exist.
Indeed. ~13 years ago I'd have said MS would be mostly irrelevant by the mid-late 2020's as they missed the mobile bus in the 00's which Google and Apple have on lock down.
But MS knows one thing well: developers (Thanks Ballmer). Azure, Github, vscode - a full stack of tools developers can use to deploy software - without Windows! Very smart move as they can't fight Apple or Google on the front end, so go after the back end - the engines that keep the lights on and money flowing.
They're continuing this tooling trend with AI which they can integrate into their existing tools to accelerate development (copilot, etc.) Honestly, with all this tooling in place I would not be surprised if we see a Windows mobile/phone OS make a comeback.
Presumably because they're all open source now?
C# is still in the top 5 according to TIOBE [4] (whether we pay any attention to that is shrug), but they reckon it's grown in usage in the past year.
Typescript is probably one of the fastest growing languages (in terms of usage).
[C#] https://github.com/dotnet/csharplang
[F#] https://fsharp.org/
[Typescript] https://www.typescriptlang.org/
Parent comment said most devs use open source technologies. That is, when given the option, most devs will choose open source technologies where possible. As such, offering licensed, closed-source products to devs is a bit of a waste. People want to pay for hosted/managed versions of open source products they’re already using, not extra for licences. This is one area I’d say AWS has the advantage.
By the time that fizzled out, it may have been deemed “too late” for it.
It's like they brought startup shipping mentality to products where users don't want fast updates and the priority is stability, quality, and performance.
I think the other two are a stretch also, but I can see where you're coming from.
I stopped perceiving this as a negative thing and started to consider it a part of google's culture. I suppose projects like https://killedbygoogle.com helped. Now I'm realising the obvious, i.e. that at the end of the day each discontinued product means sunken cost and if the product was public then also loss of trust.
The only “tear” I’d put Azure on, is “tear inducing” in the context of “being forced to use this disaster brings tears to my eyes”. Most of my friends and peers who’ve had to use Azure feel the same way.
> Microsoft's thunder, they flubbed something as simple as an ad.
Have you seen bingGPT? It’s not exactly doing much better.
> Now people are _really_ wondering if Google can execute anymore
Google has done this to themselves. Endlessly launching and axing products inevitably erodes people’s confidence, long before a marketing whiff with a language model.
Don't get me wrong, Azure has been quite successful but I don't see their investment into ChatGPT as reflecting any noteworthy change in Microsoft's own internal capabilities.
I think Brereton is missing the wider narrative. Microsoft has been executing very very well for the last few years. Azure has been on a tear, they've demonstrated great foresight with their first investment in OpenAI many years ago (which is now paying dividends), and they've made strong acquisitions. They've captured the AI lightning in a bottle. Google, has left people wondering if it can execute well. It's had a lot of flops, and a lot of project cancellations. When they announced LaMDA, they let the hype fizzle to nothing. The most we got out of that is some memeable material about a guy who wanted to get legal representation for their language model.
People have been positing about ChatGPT for search as soon as it was released. They (Google) have had months to announce _anything_, but waited until the last minute. When they finally had a chance to steal Microsoft's thunder, they flubbed something as simple as an ad. Now people are _really_ wondering if Google can execute anymore. Even I'm starting to wonder. Google is definitely rushing to catch up to Microsoft in a few areas now, and their stock reflects that reality now.