But for exploratory search and exhaustive search personalization works as an echo chamber (or filter bubble if you will) .
Then there is the problem of change and inertia. People change, their preferences vary in time. Personalization has an inertia that causes the recommendation engine to always be behind the actual preferences. It's more visible the better the recommendation engine.
I'm not saying personalization is problematic. There are problems with using it all the time and stealthily, without a clear possibility to turn it off.
It's not FUD, but a challenge to overcome.
The same way that what a user might enjoy can be inferred the inverse of that can be used as a signal in the algorithm as well. Personalization is just relevance and all is just a matter of tuning.
The challenge is that people switch very quickly between these search modes and don't even think about it.
"There is little difference between personalization and the relevance of search results."
Even if you're a Sailor Moon fan, you might actually be looking for information about the rock rotating around this planet when searching for "moon". In the same vein I might be a liberal but be looking for a multitude of opposing views and ideas when googling "core values of NRA members".
Oh btw, we engineers, our algorithms, aren't smart enough to foretell people's inclinations based on their past habits, we also can't read minds. The increasing use of personalization as a factor for relevancy will, imho, lead to user dissatisfaction, precisely because they make shoddy assumptions.
Believe it or not, but some people also want to be surprised and learn new things. YES. We exist!
The article makes the assumption that personalized search results are bad for you, then goes on exemplifying it, but does not say or demonstrate in any way why personalized search results are bad, especially since it doesn't give any context about the person making those queries.
Search ranking is a matter of context. "Egypt" does not mean anything, other than the name of a country, and different people mean different things. When you're searching for "Egypt" and want to get travel tips, if you don't get them you can always expand your query to "Egypt travelling tips". But even that is a pretty shallow request and you can further expand it like "Egypt travel guide to the pyramids".
The search engine's job is to find what I'm looking for. And IMHO the current state of the art is a little behind my expectations - I would have expected these personalized results to be far more effective than they are by now.
For general search queries, the long tail goes out the window anyway, and I haven't done or seen any quality metrics for DDG, but I doubt their search results are better for exploration or getting opinions different from your own.
From my personal experience, people rarely search for something as simple as "Egypt," and instead, search for "Egypt travelling tips" like your example.
If your Google-fu is strong, you'll write a query that targets your desired results much better than a generic shot-in-the-dark query.
Keep going to the library, keep having those conversations, and eventually, the librarian will take you straight to the books you want when you ask for Norway. If you want something different, you'll have to explicitly ask.
What Google is doing is no different. It just happens to have a lot more conversations with you.
- You blatantly correct the conversation by adding additional text to the search: "norway government" versus "norway travel".
- You subtly correct the conversation over time with more government queries/clicks/likes or more travel queries/clicks/likes.
Listening to Matt Cutt's response, it sounds like all of these signals are pretty minor anyway.
I agree with you that these seem to be small changes. So far.
Let me try this example: Suppose your searches are primarily academic. Let's say that whenever you search the term "momentum" you are looking for something scientific- ballistics, elementary particles, whatever. But one day you are writing a blog in which you want to search for background, but you need to use a non-scientific meaning of the same word. Perhaps a psychic used the term and you are debunking. The particular case is irrelevant. The point is tha if personalization is too aggressive you may not find the info most relevant to your interests.
This isn't privacy FUD or anything, just a pragmatic warning. The FUD comes when you start thinking about how their algorithms might actually decide which results you are "interested" in. Thinking of Google, what bu siness are they in? What about you behavior on the web most interests them? Would they decide that the most interesting things to you are the ones on which you clicked the most ads?
As a counter-example: Suppose your searches are primarily academic. Let's say that whenever you search the term "momentum" you are looking for something scientific- ballistics, elementary particles, whatever. But most people aren't looking for scientific info, so you constantly have to dig and dig to find anything relevant on Google. The point is, if the search technology is too impersonal, you may not find the info most relevant to your interests.
This is the crucial point. As long as it's accessible, I can get what I want by search refinement either way (but I would imagine that it would be easier for me to refine in the space in which I am familiar than to refine in the unfamiliar space). Giving me the (easy) option to turn it off is a good idea for search.
And for the record the political example was about facebook wall.
- Search for term on DDG - Look at results, find nothing - Try to find better term - Give up and use original term in Google - Find result
I tried to use DDG exclusively two time (once 8 months ago, once ~4 months ago), but the result was the same. I don't know how much personalization affects this, but Google just gives me the best results.
My own standing is that most of the time you need what you have to have to complete task at hand. Then you could go at YouTube and refresh "Recomendations" to your heart content.
The other way around is to wreak havoc to important parts of your life.
Do you have any proof that this isn't what all search engines actually do?
At least to me.
I think the chance that I would click on a bullshit source like Fox News is very low because I don't trust them. Even if Google brought it up as the first result.
My point is that people already only click on search results that they agree with. Nobody wants to see stuff that they disagree with. That is human nature.
So living in a filter bubble already happens without automatic filters. It happens in our brains and we call it personality.
Media outlets always filtered stuff for you but now the algorithms are 'filtering' results according to your interaction to find what's relevant to you, so you have a 'vote' here.
You also can dig through any initial results (click the news vertical to find more news for example) you couldn't do that with the media of yore.
If you want to understand where I am coming from then this is why I think it's an issue
http://000fff.org/slaves-of-the-feed-this-is-not-the-realtim...
Changing the language not that intuitive in Google, it's a drag. I have to do it all the time when I clean my cookies, and sometimes I still get crappy "pt.wikipedia.org" results on top instead of "en.wikipedia.org" just because my browser isn't in english and I don't want to change it just because of Google.
I might want to type www.google.it and search for Berlusconi news in Italia, but it won't let me, because it just show me brazilian news. So yeah, I can't even get to another bubble.
Also, apparently Google filters by IP, since searching via Tor or a VPS renders very different results. I dislike this for personal reasons because it breaks the internet for me.
Also, I might not like the fact that Google collects stuff about my search habits, which is also a valid concern.
So, there, it's an issue for me. Might be an edge case, might be an exception, but I think that I deserve to know why this happens and the alternatives.
Oh, you know, maybe using Google's much vaunted "PageRank" algorithm, which is supposed to take in to account things such as links on other pages back to the page being considered for inclusion in the search results.. the more such links there are, the better the rank is supposed to be.
The above description is obviously an oversimplification, and I don't have access to Google's PageRank algorithm anyway, so couldn't tell you what it actually was if I wanted to, but it's something along those lines, and need not take in to account your previous search history in any way or "personalize" the search for you.
DDG: If you want to grow, don't keep attacking the big search engines with FUD that only a miniscule % of people care about.
Searches per day in Feb average = 197,687
Searches per day in May average = 205,759
FUD certainly won't grow DDG out of the extreme niche it's in.
It's even more significant when you look at where it was a year ago. 1.2 million in April 2010, 5.9 million in April 2011, 6.3 last month, and already 3.8 a little over halfway through this month. This is significant when you consider the lack of marketing and that DDG is run by one person.
I understand the quest for a larger userbase but please don't use this sort of FUD that is being peddled by those who don't understand the technical aspects of search and are trying to sell their books.
A search engine's prime function is to filter the millions of results for each query down to the most relevant results for each individual user, and never the same 10 results are relevant to each and every user.
There is little difference between personalization and the relevance of search results.
How would you go about ranking then? alphabetically?! it's a matter of tuning the relevance 'dials' and it's all in early stages so a solution to this imaginary problem is more research and not to hide behind bullshit terminology.
And as a bonus a user (regardless of any personalization) can dig through any initial set of results if she seeks more information.
So please don’t buy into this misleading and ignorant bullshit that is being disguised as a real issue.