Perfect example of this is trying to google for mailing list posts.

All sorts of maximum ad-cram crappy sites (including ones that try to pretend to be a forum, with mailing list posts as "users") that maximize SEO gaming techniques dominate the results for 20+ pages.

http://marc.info, which is the best archive avalible atm, plain, simple no bullshit layout and is linked everywhere anytime somebody wants to reference a mailing list archive, nowhere to be found.

IMO it's because Gmane used to be highly ranked, but then it was shut down, so all those links are now gone, and the "void" has been filled with "crappy sites" like you said.

Speaking of which, does anyone know what's going on with Gmane? There hasn't been any updates since the ownership change.

How does that compare to http://markmail.org?

I am sure they all have Google's ads on them, too. Only slightly suspicious.

I can assure you adsense has no connection to crawl or rankings.

How much connection does it have to making the removal of adsense spam pages from Google's index a priority? I have a feeling it lowers that priority significantly, and if those pages were hurting Google's bottom line, it would be priority #1 for the company to remove them.

Making money is certainly a motivation for doing it.

A non-existant website won't get a search placing.

I really hate how google will show every possible copy of a newswire article before it shows local sources, etc. I've had slightly better luck with DuckDuckGo on that front, but I always feel like there is a happy medium between Google's ridiculously "context-aware"* algorithm, and DuckDuckGo's "context-agnostic"* algorithm.

What's really annoying is that if you use Google trends, it will let you know the context of what you are looking for, and you can clarify. I really hate it when I'm trying to look for something on Google, and I know it's just using the wrong interpretation of a word.

Easy example: I do a fair amount of scripting in VBA. I often want to look up documentation for things in VBA. If I use VBA in my search term, I will get a bunch of 15 year old pages on Excel tips and tricks. If I search VBA MSDN, I will get a bunch of pages on VB.net or VB6. I specifically have to use VBA MSDN OFFICE ACCESS in order to get the correct results. DuckDuckGo does not have this problem, but I use date filtering a lot, where DDG falls apart.

Search engines aside, it's ridiculous that Microsoft allowed this situation to happen in the first place.

*I'm not sure if either of those terms is remotely accurate, but they seem to articulate what I'm trying to say.

Every couple of years they seem to wipe out all these kinds of things, so you don't get them, then companies come up with new ways of writing their pages so that they all show up again.

Remember when we had all those spammy answer sites that dominated Google searches for almost any technical question?

There's still a few of those that pop up. If I am looking for an obscure error message, it might be listed in a single stackoverflow post, but then that question and answer will be repeated in 3-5 copy-cat sites, each having copied the question and answer.

I'll never forget www.expertsexchange.com. Because that isn't a job for an amature.

Um, NSFW?

It was the original domain for experts-exchange.com. Changed for obvious reasons.

https://en.wikipedia.org/wiki/Experts-Exchange

A possible solution for your particular problem is to use the site operator, e.g.

    vba sort array site:msdn.com

99% of VBA is used in Excel. The others are just an aberration as far as the indexers are concerned.

I understand, and to be fair, half the reason this frustrates me is because I wish I could be using literally any other language. Regardless, I'm often looking up classes that a) don't exist in Excel, and b) don't exist in the version of VBA used in the linked page. It's extremely confusing to click on a link and not having a single reference to the class you are trying to look up.

Furthermore, VBA <> VB. I wish I could just tell Google to stop showing me answers for VB6. It would be fantastic if I could use VB. My problems would basically solve themselves, but I'm not using VB, I'm using VBA.

Have you tried adding '-VB6' to your search queries? It will filter out those results.

https://bynd.com/news-ideas/google-advanced-search-comprehen...

That'll also filter out eg "This is only used in VBA, it's not used in VB6".

Maybe:

> VBA AROUND(20) VB6 | vba -vb6

would work?

Google provides a Chrome extension to block sites from Google Search results:

https://chrome.google.com/webstore/detail/personal-blocklist...

3rd party addon for Firefox:

https://addons.mozilla.org/En-us/firefox/addon/hide-unwanted...

Another one for DDG in Firefox:

https://addons.mozilla.org/en-US/firefox/addon/ddg-hide-unwa...

I never knew about this (and always wanted it). Thank you!

I wish this was a feature for Google when logged in (although this is a better way I guess).

It was a feature introduced in 2011 and discontinued in 2013: https://googlesystem.blogspot.com/2013/03/google-discontinue...

Hmm of course I missed it when it was around sigh

"The Google Way"™

Google search doesn't have much of an opinion about which sources to prefer other than "what users indicate answers their question". The vast majority of people _are_ looking for news coverage of scientific studies instead of the paper itself (people are generally unaware of how abysmally, unforgivably sloppy and dishonest much of science journalism is).

If you're looking for an actual paper, why not just use Google Scholar?

They do. That's actually what panda was all about:

"We actually came up with a classifier to say, okay, IRS or Wikipedia or New York Times over this side, and the low quality sites over this side." -- Matt Cutts

How does that contradict what I said in the slightest? Here's the quote when it's not pulled out of context to distort its meaning[1]:

----

> Singhal: And based on that, we basically formed some definition of what could be considered low quality. In addition, we launched the Chrome Site Blocker [allowing users to specify sites they wanted blocked from their search results] earlier , and we didn’t use that data in this change. However, we compared and it was 84 percent overlap [between sites downloaded by the Chrome blocker and downgraded by the update]. So that said that we were in the right direction.

> Wired.com: But how do you implement that algorithmically?

> Cutts: I think you look for signals that recreate that same intuition, that same experience that you have as an engineer and that users have. Whenever we look at the most blocked sites, it did match our intuition and experience, but the key is, you also have your experience of the sorts of sites that are going to be adding value for users versus not adding value for users. And we actually came up with a classifier to say, okay, IRS or Wikipedia or New York Times is over on this side, and the low-quality sites are over on this side. And you can really see mathematical reasons …

----

Cutts was using IRS/Wikipedia/NYT as stand-ins for "sources people trust", not "sources of high quality by some magical objective standard that Google decides contra their users". Ultimately, their classifier is validated against what users blocked as low quality sites, since there's no grounding for quality that doesn't come from users.

Hell, the quote you're pulling doesn't even make sense in the context of the exact example we're talking about! A lot of people would find a big newspaper like the NYT at the pinnacle of trustworthiness for factual content, more so than something like NBER or PLOS (where you can find the actual papers that NYT occasionally reports on, often not very well).

[1] https://www.wired.com/2011/03/the-panda-that-hates-farms/

"Cutts was using IRS/Wikipedia/NYT as stand-ins for "sources people trust", not "sources of high quality by some magical objective standard that Google decides contra their users"."

It ends up being the same thing. Brand value being an overwhelming factor is precisely what the OP and everybody in this thread was complaining about in their SERPs.

I sympathize with this a lot.

At least for scientific articles, it usually helps if you're willing to spend enough time to familiarize yourself with the technical jargon. As a somewhat dated example, "Higgs particle evidence" will turn up lots of crappy new articles, but "CMS Higgs abundances" will immediately return high quality relevant results.

Of course, you have to figure out the right lingo int the first place, but usually you can mine arXiv/PubMed/etc for this kind of thing. Wikipædia usually has links to some kind of primary source.

If you're using Google to find scientific sources I would recommend trying Google Scholar.

Not a perfect solution by any means, but it should get rid of news articles.

If you have access to an academic library (community college will often suffice), you can directly access scholarly and periodical indices. These will save hours as compared to a general Web search, even on Google Scholar.

Sci-Hub will turn up most of the results, LibGen and BookZZ many of the print sources.

I also have the problem when looking for new information. For the given topic you'll keep finding articles from 2014, and not of e.g. a new update that's been released recently.

Or the obverse: I'm interested in searching for an item not including current results. In some search engines (DDG, Google Mobile) you can only specify "last day / week / month / year", not excluding within recent intervals.

Google Web, Books, and Scholar, desktop versions, are better in this regard, as specific intervals can be specified. The problem here is that for the Web, there's a great deal of newer content masquerading as older. The problem appears in print as well, but not quite to the same extent.

IF you add this to the search results, you can choose some preset times to search (week/month/year).

  ?tbs=li:1

http://jwebnet.net/advancedgooglesearch.html

https://stenevang.wordpress.com/2013/02/22/google-advanced-p...

Thanks for the info, I didn't know about some of those options.

For scientific studies try Google Scholar scholar.google.com

We need some sort of "Adblock for Google search results".

Or a paid search engine incentivized to provide quality results rather than maximize ad network profits

Nice idea. But there's no sign that such a market exists. To put it into perspective, Google makes a nickle of ad revenue for every search. Would you pay that much?

I might pay subscription. I agree that the market is not likely to be big. Also data network effects and difficulty with price discrimination can be big obstacles.

EDIT: I think I misunderstood your question. I will probably pay that much for quality ad-free service. But of course it's a niche product.