I think what finally killed their search quality is the fact that there's no longer a public human-curated network of websites to draw meaning from. Most content on the web is bulk-generated crap, personal blogs and websites are rare, and many passionate hobbyist communities are hidden from crawlers in places like closed Facebook groups.
If you click into a site and you don't return to your search, they consider that an upvote. If you continue clicking different search results they consider that a downvote for the site you visited.
In addition, the best Google searches result in finding the answer directly in the preview of the page from the search results. Unfortunately there's not a clear signal to Google which site preview provided the answer in this case, or even if none of them did and I just gave up searching.
In reality, I'm sure Google's determination of which site was relevant is much more sophisticated, likely involving some machine learning.
It's early days though. I imported around 10,000 MOOCs from various platforms and organized them by topics. The webapp is open-source so fixes/features are always welcome. :)
Someone just beginning to use the internet would either need to slowly build reputation in the most open spaces, or get one or more people to vouch for them through an API.
I want to make it fiscally infeasible to run a mass persona farm.
I don't have proof but I'm sure the amount of votes on eg. reddit (or perhaps how long it was on the front page) has an effect on search results; see the Comcast swastika[0] and Trump showing up when searching 'Idiot'[1].
0: https://old.reddit.com/r/funny/comments/403brr/10_months_lat...
1: https://thehill.com/policy/technology/397920-activists-manip...
They have a tiny percentage of the market, so there will be a tiny percentage of money invested in gaming their algorithms.
My hypothesis is that Google's results aren't bad - they are actually serving a set of results which satisfies the laymen, and it's only the technical, highly niche users with whom the results don't align.
I'm surprised they haven't brought this in with an option so people can rate or at the least flag sites. Source users feedback directly which would probably help wipe out results like Pintrest that dominate so many searches but people find unhelpful.
It would be great if they had an option where they have the drop-down for cache to say something like 'dont show this domain' or something that would let people flag sites that dont seem to offer value against search terms
Also on the 'computer' search I was amazed how everything was now in a left column and how much blank space on the right there was: http://prntscr.com/pw5iav - is that mobile optimisation overtaking desktop experience?
[…]
What do I mean with “the threat of Facebook”? In the old days, before today’s large “social media” sites, people made their own web pages on places like GeoCities or on simpler social-media-like sites like LiveJournal, etc. Those sites all had content and linked to each other. This is the web which the Google search engine and its algorithm was meant to find things in, and it worked very nicely, as it took advantage of the links other people had made to your site as a proxy for relevance in search results for your site. People making small web pages about their favorite topics (with lots of links to other people’s pages, since information was hard to find) could slowly and easily transition into making larger and larger reference web sites with lots of information, thereby attracting lots of incoming links from others, which in turn enabled people to find the information using Google’s search engine.
Compare this to now. Firstly, people having a Facebook account have no place to simply place information, no incentive to simply make a web page about, say, tacos or model trains, because that’s not what Facebook is about. Facebook is about the here-and-now, and whatever is yesterday is forgotten. As I understand it, there is no real way, in Facebook, to make a continuously updated page with a fixed address for people to go to as a reference point about some subject, or at least people are not directed towards doing this as part of their online activity (as opposed to in the past, when it was basically the only thing which people could do). Secondly, this makes it so that people have no natural path going from using Facebook to creating a larger web site with information, and there are no smaller model train or taco Facebook “pages” which could have links to your larger site and thereby validate its relevance. Thirdly, even if this second point was false, Google could not use these Facebook pages, because Google cannot crawl them. These pages are all internal to Facebook, and Facebook has every incentive to not allow Google to crawl and search this information. Facebook would much rather people used their own site to search, and thereby gaining all of Google’s sources of income: User monitoring and advertising.
I'm increasingly of a mind to create an old school pre-blogging web page. That was the ideal of the web. I have enough content, it's just the time.
Google could penetrate all of that, if they wanted to.
When I search for a fairly specific thing and the first page of results don’t even include half the search terms, that indicates quite clearly they don’t give a fuck about anything other than ad revenue.
Set ya default search engine to DuckDuckGo.
If you can form a sufficiently specific query, Google is still exceptionally good at returning useful information, with few ads or infoboxes or anything else other than organic search results. If your search terms are too generic, Google essentially gives up and just serves you ads instead.
I beg to differ here. Years ago I felt like I could discover useful information about a topic through Google with relative ease.
Results would contain informational links that let me explore the subject.
This basically impossible now; with Google Search at least.
The best open source mailing list archive is unquestionably https://marc.info . yet when you search things that are open source relevant, you get https://nabble.com which goes as far as to fake being a forum and fills content from mailing lists, is nearly useless feature wise, and is crammed with all sorts of nasty obnoxious advertising.
marc.info doesn't even crack page 10 with typical queries, because they don't play the SEO optimization game, and doesn't run ads.
This is a great example of Google becoming totally useless.
The last time I remember this being mentioned on HN, a few days later marc.info was at the top of search results for mailing list type posts, but it seems whatever manual tweak they applied has since been invalidated by the Googletron...
I don't know how many times I've had to add -nodejs to things I'm trying to search to eliminate irrelevant garbage from some of my searches.
Searches you do now on basically any subject you are not an expert in already give you the same subject matter level of expertise you can expect from a 5 minute segment on the nightly news, whereas before you could expect at least the quality of a 30 minute show hosted by James Burke.
What finally pushed me away from Google was its incorrect assumption of equivalence between different terms. I'd search something like "printer scaling draftsight" and it would return results with "printer" "scaling" and "autocad" all in bold. Because autocad and draftsight are 2D CAD programs, and autocad is more popular, so suuurely that's what I wanted.
Yeah I've noticed this a lot in recent months/years. Have been finding myself putting most of the keywords of the query in quotation marks to get any kind of results relevant to my actual query. Like 'printer "scaling" "draftsight"' just so that G wouldn't make some stupid assumptions.
One page of results with 8 of 10 completely unrelated.
It interprets what it thinks I meant instead of listening to the actual words that came out of my mouth.
I have the same problem with my wife... :-)
Language is used to convey meaning. The difference between my wife and Google is that Google tries to interpret language in the lowest common denominator which leaves all people who try to use language properly feeling like they need to learn a new one just to be understood by their search engine.
...maybe that's not so different.
The internet is always going to be in constant flux: SEO trickery, the rise and fall of sites which contain the most relevant data, context of the search (browser -> phone), etc.
Google's main job is to make it as easy as possible for a user to find what they want. For example, as a techie, 15 years ago that might have meant making sure to constantly index usenet and various mailing lists. Today most of that content is at StackExchange, Github, Reddit, etc.
And it's not just tech searches - everyone will have their own niche which Google once got right and often returned as the very first result (when was the last time you were confident in using the 'lucky' result?), and now, not only do they not return relevant results, whatever they do return is mixed with tons of ads and (probably) paid results that aren't marked as ads.
The fact that Google doesn't yet pay dividends while the MBAs there are apparently intent on destroying the company's main product as fast as they can, doesn't bode well for their share price going forward.
Try searching for just the name of a supposed whistleblower, then add another term, and get all the censored results. Even more true in the news tab, which initially returned -0- results.
I’m in the latter camp and wondering if their inferences are just getting better if they have more of your data. Still not willing to give it to them willingly to get better results, but it would at least explain a few things.
I definitely have concerns with the amount of data Google has about me and, in particular, the idea of Chrome monopolizing the browser landscape. As a result, a few months ago I tried switching to Firefox, complete with container tabs and scripts which removed Google analytics from everywhere. The difference in search results was very noticeable. Most notable was that my Google news feed (on my Android phone) and YouTube recommendations quickly became filled with generic junk, whereas before it was so relevant I would often find the answer to something I had been researching earlier mixed in with my news feed.
I ended up going back to Chrome, mostly due to battery issues with Firefox, however even if I hadn't switched back I think I would have voluntarily turned off all the anti-tracking stuff. It is a data privacy concern, and moreover I hate the idea of giving Google all this data, but the benefits for me were very palpable.
I can see a world in which the parent comment is correct, and we've "dumbed down" our queries because it gets us good enough answers most of the time. For example, perhaps I used to google "halo game walkthrough OR tutorial" and now I would type "halo tips."
Shopping.google.com was much less useful because it only returned advertisers. I was able to find better matches at lower prices by entering really precise searches and using organic results.
It’s harder to find things for sale through Google now than 10 years ago.
It seems that if you don't tailor your search terms perfectly all you get is ads, clickbait youtube videos, and review sites built to push a product.
Edit: The problem in sustaining this growth isn't just marketing either. With increased traffic come increased server, maintenance, and engineering costs which may not be possible to support with untargeted ads as advertisers won't pay big money to show ads that have poor conversions.
Why would I not want verbatim results?
But I look at my non-technical relatives using Google and it's now magical how relevant the results are for vague queries regarding common information. Making precise queries for technical information work worse while vague queries for commonly referenced information work better is probably the right trade-off for a business that wants to make money. As much as I loath it for my own use cases.
Not surprisingly, Google is still better for shopping searches.
edit- DDG bangs for those who were unaware: https://duckduckgo.com/bang
Like, if I type a math formula or "what's the population of Alberta", the Google result is just the number, not a link to the result.
Or if I want to search for a product or local business.
I get the answer plus a ton of highly relevant links relating to population, StanCan sources, etc.
I think this is exactly what most users want: Show me the answer quickly without making wade through links - but provide me the links if I want to do more research on my own.
These snippets also take up more space on top of the page and along with more ads, it means fewer organic links are appearing on the first page.
I prefer to use WolframAlpha for such things.
There’s a lot that I don’t know: DuckDuckGo.com/bang should have others
90s web : content good, looks rubbish
2019 web : content rubbish, looks good
trying to help my kid with research reports &etc is a nasty chore these days -- for the amount of effort it takes to find a decent informative non-wikipedia page these days, may as well go to the physical library
It was kind of believable at the time.
Old web was a mess of people making things as expression, excitment. I think it matters to feel being 'connected' to someone rather than parsing a rendered data structure.
I felt the same reading old encyclopedias, you can feel the author way of thinking a bit. It feels a bit more enjoyable.
Or at least it would have looked good, if it wasn't covered in "SIGN UP FOR OUR NEWSLETTER" and "ACCEPT OUR COOKIES" light boxes.
Which is only slightly less rubbish than having it covered in the semi-pornographic pop-over ads of yore.
Firefox, please treat "can set cookies" as a permission and allow me to set it to "ask" by default, and allow it to be toggled by clicking on the site permissions lock box. The existing user interface does not give me any control.
I've been meaning to set up YaCy for a while and see if the P-t-P search structure works better for finding non-scroller web pages. I fear that I'll find those results also tainted by shills.
[edit: Forgot to mention Gigablast, which works fairly well. Definitely not for the faint of heart]
Those SEO'd pages are optimized for generating revenue, so they're packed to the brim with Google ads and referral links.
Prioritizing such pages generates revenue for Google, too.
Nearly all the changes since have been along those lines. Google thinks the only reason to use the net is to shop. The results you get, that are prioritised make some sense in that context.
It's just made it useless for all those times you don't want to book a hotel, buy a phone etc.
Consider the trend in ads for ad supported sites as an indicator.
The customer is the ad buyer. They want more of those. They have maximized product supply. They can't produce more product, they can only resell existing products by more ads in search results as a ratio plus more ads on the organic links.
There is no measurable financial incentive for them to show you organic results without adwords.
I know 80 to 90 percent of the results.
Google was useless. It is as if some subreddits, like one of mine, no longer exist.
Duck returned great results. And some new, unexpected results.
This kind of thing, along with hidden result links has forced me off Google search.
For fun, in my own head, they are Noogle now. NO Google.
Search Noogle for Nosults.
After searching both Google and Duck, I still don't know what "Nosults" is supposed to be.
I coined that phrase just today.
There was an economics paper published recently making an argument that we have more to fear from shitty AI/robots than good ones and I think it's spot on. (In other words, they're good enough to justify firing the person who used to do the job, but they're objectively worse at the job. What ends up happening is aggregate wealth goes down because not only are the jobs gone, but the job itself is being done less efficiently than before.)
The point where Google (and Yelp and a bunch of other services) started to turn was when they stopped just being a thing you go to when you need them to being things that get in your face to anticipate your needs. They're bad at anticipating our needs in any way that's actually useful for us a lot of the time, so it ends up putting a lot of cognitive load on us to make sure the apps/services are working as intended. Instead of just using technology as a tool as we need it, we end up needing to babysit technology that's being fussy, opaque, and unpredictable. And babysitting is the best case scenario, in other cases it's being outright hostile.
Ten years ago, I gave up subject specific databases for Google Scholar. For most of that time, I was happy. Nowadays I wish I had access to a subject specific db.
As for paywalls: I sometimes find better results by adding filetype:pdf to the title of an article in DDG than I do in scholar. They're both completely hit and miss. I think they're trying to respect copyright more nowadays than before. Unfortunately, of all the unreasonable copyrights in the world, journals and academic books are the most unreasonable, since they're trying to get libraries to buy them.
They're aiming for the "80" part of the "80/20 rule", and in the process are really good at answering natural-language queries but very bad at keyword-ified queries. So many people use their service for answering otherwise basic questions that it's become a basic-question-answering system. I suspect also, under the hood, that when the user leaves the search page and never returns they consider that a successful serve and reinforce that sort of behavior more. Whereas I leave to search the same thing on other engines because Google became useless for my job, which requires specific answers to technical questions. So I think there might be some built-in positive-feedback loops that are reinforcing this sort of behavior. Either that or peoples' queries really are that boring, all the time.
I mean all the seo’d sites have self labeled themselves as having worthless content. You really just need a search that filters them out.
You get what you measure. Google grew this monster themselves with pagerank and monetizing links.
Here's a thought I had while reading your comment...
what about a hybrid of HN/lobste.rs/reddit and old-school hierarchical lists. Basically, a place where people can upload websites and such that are relevant to a search term.
Say you wanted to know about "how to make bread". You would first check if this query is already defined, creating it if not. Then, you could comment/post links on the topic, and see other's links sorted by some hybrid of upvotes/downvotes and human moderation/curation. The point would less be about having a discussion, but more crowd-sourcing "what pages are most relevant to this query".
From the perspective of a user who doesn't participate, this looks like a hierarchically sorted collection of queries/topics and links relevant thereto, sorted by relevance.
When I try to find information on a generic topic where I can't exactly tailor the query, the results are usually filled with low quality, SEO optimized promotional sites, clickbait articles/YT videos or aggregators. With some luck there is a good blog post with quality links on page 2 or 3.
Good results are now mostly restricted to areas where Google can utilize structured data sources (Maps/Business data, Wikipedia, ....).
This is extremely ironic, since Google originally rose to popularity because it was much better at "real" search than the competitors.
The interesting question is why!
Is Google just not able to compete with SEO tactics? Are they overly fixated on ML/"AI" techniques that don't work well in practice?
Or are regular search results allowed to become worse on purpose, in order to maximize ad revenue? It is something a near-monopoly could afford to do.