Currently just to get basically workable results I'm finding myself putting "every" "keyword" "in" "quotes" (to make sure they're actually in the result pages at all), the site: modifier to restrict it to real sites, and negative modifiers (-"keyword") to remove some SEO results.
Google used to be "magic" in that it knew what you were thinking, and gave you what you wanted instead of what you asked for. These days it is just page after page of auto-generated results, pages that don't contain anything relevant to your query, or just low quality results.
I'm not going to pretend I'm an expert in Google's search, and I'm sure they're meeting some metric or another, but from my perspective things have gone seriously downhill to the point where I am looking elsewhere.
It used to be THE technical search engine de jure. Now it feels like a search engine you have to hack to get it to work well. Not a good place to be.
PS - I have read, in HN comments (so pure rumor) from self-proclaimed ex-Googlers, that Google's internal culture punishes people for improvements/maintenance to existing products, and that promotions come from developing new products/features. If even semi-accurate might go a long way to explaining why Google Search feels neglected aside from changes which seem to exist to improve their button line/promote sister products.
On the most extreme end of this, I've seen four-word queries produce results, in which three of the words were stricken out. More often, it's just one word, but it's usually exactly the one that makes the difference between a very specific query, and a very generic one.
Worse yet is that they try to do synonym substitution, but their algorithm has a ridiculously low bar for that. Like, you might be searching for "FreeBSD", and it will substitute that for "Linux", or even "Ubuntu". Or search for a specific firearm model, and it finds "gun".
Quoting keywords suppresses all of that, but synonyms are actually useful - if it did them accurately...
Maybe they're already doing this, but it sure acts like learn-to-rank is always ranking pages as if the query were very sloppy.
It's been a long time, and I certainly never read the code, but I vaguely remember a Google colleague mentioning something (before learn-to-rank) about a back-end query optimizer branch that would intentionally disable much of the query munging if there were any search operators in the query. There was some mention about using cookies / user account information to do the same if the same browser/user had used any search operators in the past N days, but I'm not sure if that was implemented or just being floated as a useful optimization.
But when Google first came out, it was a shock. You could just search for something like "Linux", and the most authoritative sites all showed up on the first page.
At least those search engines gave you that many results to go through... now Google gives you less than that, full of spam (despite the index probably containing far more), and you'll be in CAPTCHA hellban if you try harder to get to the rest.
Of course, you'd have to read a manual to use it and it would have a ton of spam, but some people just want lower-level control - they still sell stick-shift cars.
There’s a long tradition of compiling and publishing concordances, which are just indices of every place each word appears in the original text. They’re generally not useful without access to the original, so noboy seems to mind them very much. Google’s index is just a modern form of the same thing.
1) Google CANNOT provide you with technical search, because choice of index/query filters is always limited (ie. Do I prefer exact matches over multiple matches?)
2) Google has shareholder & public responsibility. It means that service is adjusted (and it's 'algorithms') towards biggest type of queries performed.
All of this is a constant battle between precision and recall for given query. Adding to complexity, Google needs to account for
* Extraordinary amount of users using their search
* Extraordinary amount of data on webpages
* Importance of authority
In smaller search engines (ie. shop full-text search) you usually adjust towards one use case. This in itself is already hard.
Google does that for all possible use cases, for all possible queries while still fighting same precision/recall battle.
To be clear. I think google is terrible, but I also think that there is no other option for them at this point.
All of this became clear for me the moment I've got interested in build search and relevance engines.
Is there a superior alternative to Google?
Cliqz has hardly anything indexed at the moment, but it actually gets relevant results from those. (e.g. "zoom privacy" brings up the Zoom privacy policy first, then three news headlines from the last 12 hours, then a news article from yesterday, then an IT@Cornell guide for making Zoom meetings private, then some more news articles, some stuff about HIPPA…) I really like it, even if it isn't great for programming at the moment.
[DuckDuckGo]: https://duckduckgo.com/ [Cliqz]: https://beta.cliqz.com/
I would agree. The quality of the company seems inversely proportional to the number of employees, https://www.cnbc.com/2020/01/02/google-employee-growth-2001-...
In the early 2000s, it was the one search engine that returned relevant results. All the old ones returned a hodge-podge of key-word matches. Google used the number of citations as a strong signal of relevance (the number of pages that linked to a page meant something).
In the age of GMail beta, Google was my hero and I wanted to work for them. They were doing new things with the browser. First was Google Pack, which included necessary software like Firefox. Then Google introduced Chrome, which was even better.
Both began to descend. I don't know, they became slower and clunkier, as if they were designed by the denizens of any number of companies. Google had about 50,000 people at this point.
Recently, I can't stand even to read Google's documentation, because of its (1) bureaucratic wordiness, and (2) cluttered layout that reminds me of that video about Microsoft redesigning the iPod box. In the early 2000s, Google was a maverick. Nowadays, Google is hard to distinguish from any other corporate giant.
Google is indistinguishable from any other corporate giant because they now are any other corporate giant.
Did anyone seriously think an Ad company would go any other way? It's the scummiest of industries. It was always just a matter of time.
And now we've given (allowed, stood by, whatever) them ALL the data for >50% of our cellular users for the last 10+ years. I'm an Android user too. Oof.
For those interested in the video
Cloned a git repo where I thought I remembered seeing the function and 500 MB of downloading later grep confirms that I remembered correctly and that the exact keyword I had been searching for is present multiple times in the source code.
My hunch is that since coders use an ad blocker anyway, it's not financially viable to operate source code search on the public internet.
I was searching for the official AWS security certificates (namely, for ISO27001), which AWS neatly publishes on their site. Even for something that specific, the real AWS certification page was at the bottom of the first Google result page. Everything above it was from various random consulting outfits, all trying to sell their "expertise".
When search terms for a company's official security certificate are poisoned with SEO, we know the well has been thoroughly poisoned.
Anyway, I typed in your query " IS027001", and you're right, the AWS result is at the very bottom of the first page on mobile. But if you search "AWS IS027001" it's at the very top.
But IS027001 is not an AWS-specific thing, and the results above it are about the standard. It would seem equally bad to return AWS's product pages to somebody looking for information about the standard.
There's definitely an argument that there are too many results from random websites satisfying the "general information about this standard" intent and it would be good if google could guess what everyone wanted simultaneously, but the query is pretty ambiguous...
To be fair, in my case the lack of information is real (I've gotten only a minuscule amount of info by asking on niche forums sadly), but cutting out the noise early would be helpful.
But I perceive this as Google losing the battle with SEO. On one hand Google writes the algorithms, and on the other SEO tries to exploit these algorithms to rank as high as possible.
I was thinking that a solution would be instead of page rank, have an author rank. This rank keeps track of authors that are experts at certain topics. When you search for certain keywords, the articles of these known experts are ranked higher.
The ones that do best, the ones that are the greatest public benefit, seem to be governed by a strong leader who stays at the helm.
As soon as the people at the top change, you get jostling and unclear leadership, and power gets diffused.
You get emergent behavior - lots of internal and external competing for power and interests - and the ability to say "no" or "this sucks" or "we will do this" happens less frequently.
Normally competition would take care of all this, but with big gorillas that dominate a market, it might take a while.
Not necessarily. When you find yourself with beancounters and MBAs at the helm, they for sure will optimize the company to outcompete others. Such companies will eventually die from the rot, but not before they drag down the entire industry they're operating in.
SEO spam instead of car repair manuals is a joke. It has a lot bigger and scarier implications. Just try imagining someone like Obama winning elections now... simply not possible... And it's not because people became more dumb, they totally didn't: it's just because now dumb people have a voice online. And spend money online. Internet works for them now, and shows everyone what they want to see...
Overnight Oats as an Example. You just find pages upon pages of blogspam. And almost every page has the same useless information. No normal recipe site is somehow in the top 10 pages.
You may be overlooking where Google found the missing words or concepts in a page that linked to the hit, just not within the hit itself. That can actually be useful sometimes.
Then why not just show that as the result.
That can actually be useful sometimes.
...hence why the related: operator exists, it's just not the behaviour that most people expect by default.
Which makes their mission statement "to organize the world's information and make it universally accessible and useful" come across like a bad joke. They really should update it since they don't even bother to keep up appearances anymore.
Thoughtful critique that adds information (like userbinator's GP comment) is of course welcome.
Two more examples are error messages and IC part markings --- searches are flooded with results that do not even contain all the words in the query. I didn't put those words there for no reason, ignoring them is absolutely unacceptable. This becomes ridiculous when you search for error numbers, where a search containing the exact number and the word "error" gets flooded with plenty of useless results about other errors.