Just curious, which ones? I remember Google felt so far above any other search engine for a very long time.
No question about the "feel", but it's amazing how perception fuels reality. We did a lot of studies of this, and one of the more interesting ones was that if you told people they were seeing Google search results (regardless if they were), they'd be more inclined to rewrite their queries and look farther down in the search results, rather than try using another search engine. Beyond the obvious revenue & marketshare benefits, this helped Google two-fold technically: it gave them better data on query rewrites and search results. The hoops you had to jump through to match our exceed their performance were substantial.
We did a lot of studies of this, and one of the more
interesting ones was that if you told people they were
seeing Google search results
This is super-interesting; where might one read more about these studies?Also, when were the studies done?
I'm curious about the "when" because I think Google's reputation has slipped quite a bit.
In general though, consumer confirmation bias is not that surprising, right? Particularly with technology brands, it's pretty well established that confidence in the brand leads one to be more likely to attribute failure to one's own "mistakes" and therefore invest in further exploration of the product and/or modifying one's interactions with it. It also diminishes one's belief that another product would produce better results, therefore diminishing interest in exploring alternatives; it also leads one to perceive a product's performance as "better" when it is exactly the same.
But in 2001-2002, I remember Google having a significantly better search experience. And it was massively better than all it's competitors from the 90s.
A large factor were the snippets, which gave you a decent indication if the result was relevant before even clicking. Before the other search engines copied that feature, they would just show the contents of the meta description tag.
It also seemed to index a much wider range of sites and ranked them better.
Yup, I would say it was better through most a good chunk of 2002, which garnered it [checks notes]... about 16% market share at that point. If you include the AOL traffic, that'd be 21%. To put that in perspective, MSN's search market share grew by more than that entire share just in 2003.
> A large factor were the snippets, which gave you a decent indication if the result was relevant before even clicking. Before the other search engines copied that feature, they would just show the contents of the meta description tag.
Yup, the impact of that UX was huge. It really improved conversion rates. Everyone else figured that out pretty quickly and adopted that.
> It also seemed to index a much wider range of sites and ranked them better.
Really, it was the ranking function. As their competitors rapidly discovered, having a broader set of sites actually made having a good ranking function so much more crucial.
No way Altavista or Inktomi offered better result than Google. I was a heavy user of both, having adopted AltaVista mainly for similar reasons that I adopted Google, because AltaVista had way fresher and more extensive content than competitors at the time, it offered query modifiers, multi-lingual queries, and media search (images, etc), it even had Babelfish translation. It was obviously, unequivocally better than everything else before it. So the value proposition was unambiguous.
Google was similarly an obvious value proposition when it launched. PageRank was objectively better at returning the most salient results. AltaVista did ranking purely based on how the query phrase matched the index. As the Web grew, the amount of junk it would return piled up, it's easy to spam or game such a ranking algorithm.
As for Inktomi, you can read Inktomi's own employee account: https://www.searchenginewatch.com/2012/05/10/why-google-beat... Inktomi employees were using Google Search as their primary search engine. If you're not using your own product, you've got problems, how can you expect your customers/users to use it if you won't?
Yes, Google's brand is strong, and marginal returns in search quality mean most consumers won't notice the difference between engines, and will judge based on brand or UI presentation now. But to claim Inktomi and AltaVista matched Google Search results I think is rewriting history, when Google launched, the difference in quality was quite obvious and striking.
These days search engines have other requirements given how big the web is, how rapidly it changes, and how many adversarial attacks are made against it (blackhat SEO/webspam). You've got to have the infrastructure to index the entire web frequently, you've got to have a robust defense against spam, and you've got to have an even better ranking strategy beyond PageRank because a lot of the long tail may be good content, but doesn't have many authoritative sites linking to it.
There's still the possibility of someone upstaging Google, by building a search engine that not only indexes the Web, but has the reading comprehension to understand it, and understand queries from the context of gained knowledge. The first company to do that will kill Google Search, as the results will be self-evidently better. There are queries today that GPT-3 can do that Google can't, they're amazing when they work, mindblowing. If you can scale that to the Star Trek level computer, you win.
But you can't displace Google with a 2% improvement in results.
Yes, that would be a foolish claim. Fortunately I made no such claim.
The differences at launch were indeed striking, much as they had been with HITS. That was in 1998. Four years later, at the time the article you linked to was posted, Google's market share was... 16%. While at that point they may have dominated mind share and brand value, they didn't dominate the market. That would come later.
Google's situation in 2002 was that they were no longer such a clear cut winner. Per the article: "Google much like Inktomi, must re-evalutate what itβs currently doing... ...search is going strong but the Penguin update has raised a lot of questionable results to the surface". Their search quality was already faltering. Of course, in the next twelve months, they'd literally gain as much market share as they'd garnered in the entire history of the company (and yes, that was a one time leap in market share).
I'll say it again: most of the market share gains came from the distribution channels. The cost of getting customers to switch was gigantic compared to the cost of just presenting them with your search engine first. The number of people using the Internet was growing by leaps and bounds then.
> There's still the possibility of someone upstaging Google, by building a search engine that not only indexes the Web, but has the reading comprehension to understand it, and understand queries from the context of gained knowledge.
That's been tried and failed. The technical difference didn't garner the market share needed to support it. I wouldn't say it is impossible for it to happen, but the odds are long, and ultimately the market largely does not appear to care.
> But you can't displace Google with a 2% improvement in results.
I guess it depends on how you are measuring 2% improvement, but by conventional metrics of the time, a 2% improvement now would be well neigh impossible to achieve. Again, that's part of the problem: the head of search engine queries have effectively been optimized to the point where there is little room for improvement beyond tiny fragments of the tail that amount to a percent or two of the average person's search history.
If you look at the queries in GPT-3 that are used to extract structured data, or to synthesize answers, the technical difference is huge, but it just has a high failure rate.
The various vertical search systems are examples of this, but the key to a next-gen system isn't to hand-code such verticals, but to have the AI be able to create an infinite number of them on the fly. Vertical based on Julia code? Yes. Vertical based on Pokemon cards? Yes. Today these things are hand-curated collections.
There's also the general switch from searching for information, to doing things. We've gone from 10 blue links, to answers, to assistive functionality. The current state of assistive functionality is pretty shitty and has a long way to go IMHO.
Yup. Though there are other systems that arguably had more technical success.
> There's also the general switch from searching for information, to doing things. We've gone from 10 blue links, to answers, to assistive functionality. The current state of assistive functionality is pretty shitty and has a long way to go IMHO.
Yes, I agree there's a great deal of opportunity for technical innovation. I expect to see a lot of it from Google themselves. Just don't kid yourself about the impact of those innovations on market share.
The actual technological innovation in the search product was minimal (the stuff they did later to scale was pure innovation, but that came much later). They largely purchased their position (for a good price).
Because of their success with their initial data center approach AltaVista was arguably one of the last to shift to a model that more closely resembled the one Google employed, but they certainly did a very fine job of it (late mover advantage and all that). I still liked AllTheWeb's data centers somewhat better, but at that point the differences were pretty small.
I wouldn't agree with your characterization of Brin & Page's contributions, but their direct technical contributions to Google by that time were at best marginally greater than Yang's, so it's not really relevant anyway.
Google definitely had some great tech, but the extent to which that won them the game is more myth than reality. Their aggressive strategic moves are really what made them successful.
In 1996, I worked in a group on digital cash payment schemes, digital checking, years before PayPal, they had a trusted enclave (CITADEL PCMCIA card), we had a MIME plugin for Mosaic and Unix email that would do peer to peer digital money transfers, and when it came time to ask "when are we going to try to productize this", the answer came back "we talked with banks and will be ready to do a pilot project in 5 years"
This is much like Steve Jobs "stealing" GUI, Smalltalk, and Ethernet from PARC and claiming there was no innovation. At that stage, shipping something consumers can use is innovation.
If you were a techie/engineer in 1998, as opposed to a general consumer (of which there were very few), Google results WERE better than AltaVista and competitors. The early adopters and pioneers switched because like with Chrome v1, a lot of the value proposition was obvious.
The bigger question perhaps is why didn't their competitors react quickly to prevent their rise, and I think the answer to that is in general, once a company makes a large splash, and gets the public attention, it's hard for others to overcome the free value from being the thought leader. This is true of Apple and true of Tesla in cars. Tesla makes the best EV right now. It's sexy, it's fast, and Elon Musk commands the world's attention. One day, other brands will catch up, they'll be Tesla competitors just as good, but no one will care, and Tesla -- if Musk doesn't fsck it up -- will continue to have a halo effect, a reality distortion field.
I disagree. Inktomi, Altavista, and AllTheWeb weren't even close in terms of search result revelance and the number of pages they indexed. Every time they attempted to close the gap, Google would just widen it with stuff like real time search, their revolutionary maps UI, and gmail.
When you actually measured the result relevance number, it turned out that all the major engines were pretty similar, and Google often was not the top one. More importantly though, the observed phenomenon was that no matter how bad the results you presented were, most people didn't switch to another search engine.
I get that you're a Google fan, but GMail & Maps weren't part of the search engine. Ironically "real time search" was rolled out as a PR move to counteract the narrative that was being constructed at the time: that Google was falling behind UX innovations in the search engine space. All of the above were rolled out after Google was the dominant player in the search space.
Google has absolutely done some amazing things, and their search team is second to none, but the narrative that they became the dominant player because of their technical advantages is very misleading.
> More importantly though, the observed phenomenon was that no matter how bad the results you presented were, most people didn't switch to another search engine.
That may be the case today because the results are similar now, but it wasn't the same case years ago. The ancient search engines prior to Google weren't much better than human curated directories like Yahoo. Otherwise, why would anyone switch from them to Google?
I'm sorry, I guess I inferred the wrong conclusion from your statements. I would argue that your perception of Google at the time would be a more significant factor influencing your perception of their performance, but that's actually largely beside the point.
> That may be the case today because the results are similar now, but it wasn't the same case years ago. The ancient search engines prior to Google weren't much better than human curated directories like Yahoo. Otherwise, why would anyone switch from them to Google?
I think your question at the end there underlines the central point of confusion here. While some people do indeed switch search engines (depending on how you measure, somewhere between 10-30% of users), the vast majority do not. Even when presented with what one would expect to be the worst search engine in the world (one that presented only paid search results), most people would not switch to another engine.
So the answer to your question is: most people don't switch from any particular search engine to any other search engine.
I would be the first to agree that there was definitely a window of time where Google was observably producing better search results than their competitors, and I'm sure you were amongst many others (including myself) who switched to them at that time... but again, that was a small subset of the population.
The search engine space was (and is) very competitive, and it did not take long for competitors to react and close the gap. When we measured performance in 2004, Google did not come out on top. Subsequent measurements produced similar outcomes, although occasionally Google would come out on top. Having more relevant results definitely lead to increased adoption, but only of a small segment of the much larger market.
Unless you count AOL searches as part of Google, Google didn't lead in market share until ~2004 (and it really wasn't until 2005 that they were ahead by more than a paper-thin margin). At that point, they had slightly less than 30% market share as compared to present market share which is closer to 90%. Even by 2004, the predominant way that search engines acquired new users was not through "switchers" changing search engines because of better results, but rather because of distribution deals (like the deal Google had with AOL) where a distributor would make a particular engine the first one users were presented with.
Think of it this way: how many times have you checked to see if other search engines were performing better than Google? After you switched to using Google, how regularly did you check to see if other alternatives were doing a better job? Most people I've spoken with never even heard of Powerset, let alone tried it to see if it served their needs better than Google. If consumers never check, it's hard to believe product performance makes a difference, right?
That's the reality of the search engine business. It certainly helps to be better than everyone else at search, but it is no where near the primary driver of market share.
On the other hand, my personal experience just tells me that you are wrong. Like the other commenters, I distinctly remember just how much better Google's search was back in the days. And I must be one of those cited 10%-30% of users that try to switch search engines, as in recent years I have tried twice to switch to DuckDuckGo for privacy reasons. Both times I had to return to Google because DuckDuckGo's results were just too bad (for me).
Perhaps you are right, and it is just an illusion that Google search results are better. But intuition and Occam's razor tells me that most likely it's just still the best general search engine.
One example supporting that theory is the fact that users have discovered that other search engines, first Bing, and now Yandex, are better suited for specific types of content, and are indeed using those search engines when searching for that type of content. This goes counter to your claim that users don't switch search engines even when there is a difference in search result quality.
DuckDuckGo is working at a significant disadvantage as compared to Google. For starters, they have significantly smaller market share. This is no longer like the days of yore when the market was much more fragmented. Google's market share is roughly 18x larger than DDG's. That means they get far less behavioural data to inform their ranking algorithm. That also dramatically impacts the amount of revenue they can feed in to the engine (and the impact isn't linear, as I mentioned elsewhere). Then add on that their privacy efforts mean they are deliberately blinding themselves to much of the data that can be used to tune a search engine. It'd be amazing if their result quality was better.
Again, it wasn't an illusion that Google's search results were better, particularly whenever people switched (which mostly happened long before Google gained a dominant market share). I would argue that even with comparable technology, today Google has an overwhelming advantage over competitors. I'd be surprised if it weren't absolutely the best at least amongst any of the alternatives that most people would even consider. That's just not how they got most of their market share.
The illusion is that technical advantages were the primary driver of Google's success in the search engine market, and that Google has consistently been the best search engine in the market. The former is just clearly not true (the AOL deal alone helped them way more than any subsequent technical innovations), and the latter flies against the evidence that at the very least during height of the search engine wars, result relevance was very competitive.
> Long before Google became such a dominant player, competing search engines had matched or exceeded its quality, compute cost, and ability to scale.
Could you say more about this? I wasn't involved, but my recollection is that Google pioneered using a zillion low-cost nodes for search. E.g., I remember that AltaVista was using a big iron approach partly as a way of showing off DEC's wares. I can believe everybody had to try to keep up, but I am skeptical that Google slowed down enough for everybody else to catch up and/or surpass them.
It's the nature of innovation that something that puts you ahead doesn't create a sustainable advantage (e.g. AltaVista as you highlighted), and there tends to be some marginal advantage for second movers of having the benefit of hindsight. I don't know that anyone knows the why of how this played out in Google's case, basically no one is privy to all the information about each search engine's operations, and to the extent they do, they likely cannot share what they know.
Certainly, on the cost side, Google's approach wasn't entirely novel in the sense that there was a lot of expertise already out there on how to run low-cost nodes at scale. Reverse indexes are actually a pretty "embarrassingly parallel" problem, and Page Rank style algorithms don't really make it much more difficult. In short: once Google demonstrated the value of the approach, it was pretty easy to figure out how to implement it. Google certainly continued to innovate on their data center designs, but if anything were at a disadvantage in terms of rolling it out because they already had a substantial investment in their existing designs that were working pretty well for them. There were also startups like FAST (AllTheWeb) that sprung up after Google and were able to leapfrog Google much as Google leapfrogged its competitors.
In terms of relevancy, we did do double-blind style evaluations of the relevancy of search engines as well as of the consumer behaviour with search engines. What we found was that by 2004-2006, search engine competitors had largely closed the relevancy gap, and in some cases reliably exceeded Google. What we also found though was that it largely didn't matter. Even when presented with terrible results, most of the population would not switch search engines. Indeed, most of the growth in market share amongst search engines came through distribution deals where users would be presented with a search engine as the default.
Now, that's not to say that people didn't switch because they found a search engine to be better. They absolutely did.. but only 10-30% of the users would ever engage in switching behaviour for any reason. Getting those users certainly would help you, but the vast majority of the market was driven by other factors.
That's the myth, but it's pretty far from the reality. Long before Google became such a dominant player, competing search engines had matched or exceeded its quality, compute cost, and ability to scale.
> All at a time when the web was exploding: only 19% of people used the web at Google's launch; by 2008 it was circa 70%.
Bingo. You nailed it. It turns out the search market was largely a distribution game. You wanted to be the search engine distributed to that massively growing audience, and Google did a great job of establishing itself as the first search engine presented to people.
> It seems to me that by 2008, there were fewer easy innovations lying around to make.
There's certainly been a lot of innovations in search since 2008, but nothing that was "disruptive". It's very hard to get more than a small percentage of people to change what search engine they use, and advertisers are not particularly interested in chasing that segment of the population.
> The way that other people have tried and failed since points that way too, as Google's market share is even larger now than it was in 2008.
Yeah, I really have to scratch my head at how people look at the empirical evidence and think that in 2008 it was a mistake to recognize the losing position competitors were in.