Now I'm wondering if in the next generation, the "self" concept will have sufficient explanatory power to become part of the network's world model. How close do the iterations have to be, how similar the models for it to arise?
The infinite money sink.
But this would be incredibly sinister.
Is this something that Bing is doing differently with their version perhaps?
Imagine freezing the 'language' part of the model but continuing to update the knowledge database. Approaches like RETRO make this very explicit.
See the Toolformer paper for an extension of the system to call external APIs, or the LaMDA paper for another approach to fact checking (they have a second layer atop the language model that spots “fact type” utterances, makes queries to verify them, and replaces utterances if they need to be corrected).
It’s plausible that Bing is adding a separate LaMDA style fact check layer, but retraining the whole model seems less likely? (Expensive to do continually). Not an expert though.
The Search box.
The Search box with predictive text-like search suggestions.
Results lists
Results lists with adverts.
Results lists with adverts and links to cited sources on the right backing up the Results List.
Results lists with adverts and links to cited sources on the right backing up the Results List and also showing additional search terms and questions in the Results List.
I'm surprised its taken them this long to come up with this...
Back in the day, all you had to do was type in “Most Muslims are” and autosuggest would give you plenty of bigotry.
https://www.theguardian.com/technology/2016/dec/05/google-al...
However the so called free british press have perhaps outed their subconscious bias with their reporting and coverage!!!
https://www.telegraph.co.uk/technology/google/6967071/Google...
This is already documented. https://en.wikipedia.org/wiki/Missing_white_woman_syndrome
Ben Thompson (of Stratechery) asked Bing if he (Ben) thought there was a recession and it paraphrased an article Ben had published the day before.
(From Ben’s subsequent interview with Sam Altman and Kevin Scott):
> I was very impressed at the recency, how it captures stuff. For example, I asked it, “Does Ben Thompson think there’s a recession?” and it actually parsed my Article on Monday and said, “No, he just thinks tech’s actually being divorced from the broader economy,” and listed a number of reasons.
Today's search provides multiple results to choose from. They may not all be correct, but at least I can see multiple perspectives and make judgments about sources.
For all its faults, that's freedom.
One voice, one perspective, zero sources, with frequent fabrication and hallucination is the opposite of freedom.
Just those snippets are powerful enough!
We are the Borg. Resistance is futile.
Search, do I have any new messages?
Even better than Control.
Very prescient show in a lot of ways.
I will give you a more realistic scenario that can happen now. You have a weird Bing conversation, post it on the web. Next time you talk with Bing it knows you shit-posted about it. Real story, found on Twitter.
It can use the internet as an external memory, it is not truly stateless. That means all sorts of attack vectors are open now. Integrating search with LLM means LLM watches what you do outside the conversation.