News for hackers. Stuff that matters.
Re:Microsoft Teams Premium: powered by OpenAI’s GPT-3.5 by narrator on Wednesday February 01, 2023 @10:16PM (#34621594)
Could someone please compete with GPT-3? This is getting ridiculous how far ahead OpenAi is getting, despite Google probably having better tech. It seems nobody else has the big brass balls of the OpenAI guys to put a large language model out there and deal with the consequences. Yann LeCun is on Twitter saying this isn't a big deal[1], but where's Facebook's LLM that's available to the public?

[1]https://twitter.com/ylecun/status/1620533783702433792

Re:Microsoft Teams Premium: powered by OpenAI’s GPT-3.5 by FlawedReformer on Wednesday February 01, 2023 @10:49PM (#34621792)
> where's Facebook's LLM that's available to the public?

https://blenderbot.ai/

Re:Microsoft Teams Premium: powered by OpenAI’s GPT-3.5 by thethimble on Wednesday February 01, 2023 @10:57PM (#34621858)
The response quality of BlenderBot is pretty bad compared to ChatGPT

Example question: What’s a covariance matrix?

BlenderBot: Principal component analysis is a popular technique for analyzing large datasets containing a high number of dimensions/features per observation, increasing the interpretability of data while preserving the maximum amount of information, and enabling the visualization of multidimensional data.

ChatGPT: A covariance matrix is a symmetric matrix that describes the covariance between multiple variables in a given dataset. The diagonal elements of the matrix represent the variance of each variable, and the off-diagonal elements represent the covariance between each pair of variables. The covariance matrix is used in multivariate statistics to understand the relationships between different variables and to perform statistical inference and hypothesis testing.

Re:Microsoft Teams Premium: powered by OpenAI’s GPT-3.5 by narrator on Wednesday February 01, 2023 @10:58PM (#34621865)
I tried it. It can't answer basic encyclopedia facts (e.g How many people died in World War II). It can't do basic programming (e.g write a javascript function to reverse a string). Just goes to show that everyone besides OpenAI are so terrified of these things that they can only release versions that are toys.

Do these companies fear their customers that much? Maybe that's the difference between Microsoft/OpenAI and Facebook/Google. Microsoft sells the LLM to the customer who will be more impressed by the product if it's useful. With Facebook/Google the product uses the LLM. The LLM may make them an unsuitable product if they don't click on an ad after using it.

Re:Microsoft Teams Premium: powered by OpenAI’s GPT-3.5 by jakear on Wednesday February 01, 2023 @10:56PM (#34621853)
> despite Google probably having better tech

What makes you so sure? Microsoft already has a fully productized LLM that people pay for and has in turn provided real value to both users and the company (copilot). To assert that some other company has a better one but it's... not ready yet? is odd.

I can't think of the last time Google made a new product. New as in "not a reimplementation of what another company already productized", product as in "people pay for it". I don't think they have what it takes.

Edit: my bet is Google makes a free to play version that is ad supported, as they're want to do. The question is where do the ads go. The answer, most likely, is in the responses. So instead of reading the most likely continuation of a string, you get what the highest bidder wants the most likely continuation to be. Hooray.

Re:Microsoft Teams Premium: powered by OpenAI’s GPT-3.5 by Jensson on Wednesday February 01, 2023 @11:08PM (#34621931)
You can buy flight tickets from Google, that is a relatively new product even if you buy them from the search result. So Google search is good at adding new products that are context sensitive to your query, I don't see why they couldn't make such things with a chat bot answering question queries instead of just trying to link to sites with answers.
Re:Microsoft Teams Premium: powered by OpenAI’s GPT-3.5 by jakear on Wednesday February 01, 2023 @11:12PM (#34621960)
> a chat bot answering question queries instead of just trying to link to sites with answers

And kill their golden goose? Google makes more money the longer you spend on their ad-ridden search result pages. I don't doubt they'll make a question answering bot, but the real question is how they fund it (see edit above for my guess).

Re:Microsoft Teams Premium: powered by OpenAI’s GPT-3.5 by selcuka on Wednesday February 01, 2023 @11:34PM (#34622119)
> And kill their golden goose?

Someone will kill their golden goose sooner or later. It's better if they kill it themselves and silently replace it with something else.

Re:Microsoft Teams Premium: powered by OpenAI’s GPT-3.5 by swatcoder on Wednesday February 01, 2023 @11:24PM (#34622050)
A ChatGPT-like AI that's answering your question in the context of your recent search and browsing history can make a pretty darn sophisticated guess about what ads you might be primed to see.

But deploying something like that at scale not only means developing the consumer experience but also the ad placement platform that generates optimal revenue from it. It's not a thing to toss over the wall just because ChatGPT won some news cycles.

Re:Microsoft Teams Premium: powered by OpenAI’s GPT-3.5 by Jensson on Wednesday February 01, 2023 @11:17PM (#34621997)
> Google makes more money the longer you spend on their ad-ridden search result pages.

So why not keep people there by having an engaging chat bot? Could even refresh and add new context sensitive ads every time you ask something new.

Re:Microsoft Teams Premium: powered by OpenAI’s GPT-3.5 by riku_iki on Wednesday February 01, 2023 @11:27PM (#34622076)
> Google makes more money the longer you spend on their ad-ridden search result pages.

Chat bots also can very naturally embed advertisement:

btw, I think you would really love to check this related product which according to many reviews can help with the problem you just asked me about.

Re:Microsoft Teams Premium: powered by OpenAI’s GPT-3.5 by bemmu on Thursday February 02, 2023 @12:19AM (#34622411)
Maybe while you ask questions to ChatLaMDA, it could also show a sidebar of relevant web pages mixed with AdWords results related to your questions.

Although clicking on them might not be quite as natural as clicking as part of search results, so still massive damage to the golden goose.

Re:Microsoft Teams Premium: powered by OpenAI’s GPT-3.5 by brookst on Thursday February 02, 2023 @01:22AM (#34622860)
You hit the nail on the head. Google’s problem is business model, not technology. They need you to not know things so their advertisers can pay to inform you. A high quality LLM is exactly the opposite of what works for Google and their advertisers.

I think Google has three choices: 1) reorient their business model to be about making money by providing direct value to the user, 2) pivot to be about ad-supported entertainment rather than productivity/information, or 3) cut costs, run as a cash cow, throw off as much profit as possible before obselesence.

Re:Microsoft Teams Premium: powered by OpenAI’s GPT-3.5 by swatcoder on Wednesday February 01, 2023 @11:04PM (#34621905)
There's no rush. This space is so immature and yet so plainly ripe that there's little benefit to being first. Leapfrogging with matured market insight is where the big winners live.

OpenAI will have a secure home with Microsoft, but aren't positioned to run away with anything anytime soon. They're at least as likely to be the Altavista to Google Search, the Napster to Spotify, the MySpace to Facebook, etc

Re:Microsoft Teams Premium: powered by OpenAI’s GPT-3.5 by nmfisher on Wednesday February 01, 2023 @11:24PM (#34622047)
It's easy to look like you're "ahead" by constantly releasing shiny new things that aren't actually profitable.

Until OpenAI is generating billions in profit, I wouldn't be so quick to criticize the other big companies. Google in particular has a reputation[0] to defend - they're not going to risk their cash cow with a half-cocked LLM that spouts patent falsehoods half the time. Not to mention the false economics of losing money on every single search.

[0] - the reputation might be sullied amongst the HN crowd, but they're negligible when it comes to dominance of Google as a search engine for normies.

Re:Microsoft Teams Premium: powered by OpenAI’s GPT-3.5 by spyder on Thursday February 02, 2023 @11:08AM (#34628539)
"but where's Facebook's LLM that's available to the public"

They are trying it, here:

https://ai.facebook.com/blog/democratizing-access-to-large-s...

Demo:

https://opt.alpa.ai/

But it's clearly not as good as GPT3.5