News for hackers. Stuff that matters.
Re:RIP Google PageRank score: A retrospective on how it ruin... by rco8786 on Wednesday March 09, 2016 @01:25PM (#11254666)
Really crummy title. PageRank is the reason we HAVE a search as powerful as Google, and largely the reason the web is as good as it is today.

Raise your hand if you want to go back to AltaVista/AskJeeves.

Re:RIP Google PageRank score: A retrospective on how it ruin... by takeda on Wednesday March 09, 2016 @01:43PM (#11254836)
I actually miss old AltaVista I always could find what I was looking for with their boolean expressions. Yes, perhaps it was harder to some, but it worked well.

With Google, I feel like I have to fight with it. If I'm searching for something obscure or perhaps a word that is misspelled on purpose it thinks it knows better what I'm looking for. It also often returns searches without the word that I searched for and often ignores when I prefix it with + or put in quotes.

Re:RIP Google PageRank score: A retrospective on how it ruin... by lobster_johnson on Wednesday March 09, 2016 @02:30PM (#11255166)
If you quote a word or phrase, it will be treated as required, just like "+" used to work with AltaVista.

You can also click on the "Search tools" button and select "Verbatim" from the "All results" dropdown. This causes the search to only perform exact matches: https://support.google.com/websearch/answer/142143?hl=en.

And yes, I also spend a lot of time fighting Google's inferral rules. I remember doing a search for Biber at one point, and it asked if I meant Bieber instead.

Re:RIP Google PageRank score: A retrospective on how it ruin... by flyinghamster on Wednesday March 09, 2016 @03:42PM (#11255601)
Not quite: I've sometimes put "CentOS 7" in quotes when looking for something CentOS 7-specific, only to have Google return pages and pages of results for older versions of CentOS. These days it's almost a crapshoot whether or not I'll get relevant results from Google.
Re:RIP Google PageRank score: A retrospective on how it ruin... by Gracana on Wednesday March 09, 2016 @05:51PM (#11256270)
As lobster_johnson says, verbatim mode is key. I wish it was the default - I'm always using specific phrases the google re-interprets into something more popular. A big pet peeve given my line of work: I know autocad is more popular, but please google, I really do want results about draftsight!
Re:RIP Google PageRank score: A retrospective on how it ruin... by lobster_johnson on Wednesday March 09, 2016 @03:57PM (#11255692)
Did you try the verbatim mode?
Re:RIP Google PageRank score: A retrospective on how it ruin... by nandhp on Wednesday March 09, 2016 @01:54PM (#11254907)
Ignoring words in your query that it doesn't like is a relatively new behavior for Google -- in the last three years or so. But yes, there's a reason why I keep a search keyword for Bing.
Re:RIP Google PageRank score: A retrospective on how it ruin... by yolesaber on Wednesday March 09, 2016 @02:49PM (#11255308)
It is one of the most annoying and user unfriendly anti-patterns I've ever come across. It is SO irritating when you are searching for, say, "Hackernews ramen" and you get thousands of results all with the little gray strikethrough text saying "ramen" doesn't appear on the page. If it's not there why bother even returning the result? I know the answer (Ad money / SEO) but it's like one of the basic tenets of information retrieval and they just said fuck it.
Re:RIP Google PageRank score: A retrospective on how it ruin... by neolefty on Wednesday March 09, 2016 @06:50PM (#11256507)
But synonyms! I want to say that if I search for "London Ferris Wheel" and I find "London Eye" without the words "Ferris Wheel" anywhere on the page, that's fine.

However, 5 minutes looking through my Google Search History, and I don't see any examples where non-verbatim results would have been useful, so hmm.

Re:RIP Google PageRank score: A retrospective on how it ruin... by yolesaber on Wednesday March 09, 2016 @08:20PM (#11256855)
If Google highlighted that these synonyms appeared in the article, that'd be great. They don't. Thus I, the user, am forced to conclude that the relevancy of the result is pertinent to the other words i.e. the more general search I was trying to avoid by adding in the other word! It's madness I tell you.
Re:RIP Google PageRank score: A retrospective on how it ruin... by vgeek on Wednesday March 09, 2016 @08:58PM (#11256995)
They have to grow query count (see: marketable inventory), and what better way to do so than serving useless results on your first queries, leading to additional queries?
Re:RIP Google PageRank score: A retrospective on how it ruin... by leeoniya on Wednesday March 09, 2016 @02:00PM (#11254939)
AltaVista was excellent because of those booleans. Particularly, "NEAR".
Re:RIP Google PageRank score: A retrospective on how it ruin... by kolinko on Wednesday March 09, 2016 @03:45PM (#11255617)
"NEAR" is default in Google I think. If you look for "car" it will find sites that say "automobile"
Re:RIP Google PageRank score: A retrospective on how it ruin... by leeoniya on Wednesday March 09, 2016 @03:49PM (#11255644)
NEAR worked differently. it would search for text where 2 unrelated words were physically close to each other, like in same paragraph. it's more simple than what google does, but surprisingly effective.

e.g. "brakes NEAR ford NEAR (problem OR issue)" would bring back results with "brake issues with fords..." as opposed to AND where all words simply appear on the page.

no other search engine at the time offered anything near this power. the amount of crap eliminated by a properly constructed query was breathtaking

Re:RIP Google PageRank score: A retrospective on how it ruin... by _delirium on Thursday March 10, 2016 @03:18AM (#11257908)
LexisNexis (database of court decisions, newspaper archives, etc.) still has the NEAR feature, and I've found it very useful there.
Re:RIP Google PageRank score: A retrospective on how it ruin... by alecrn on Wednesday March 09, 2016 @02:12PM (#11255036)
As far as I can tell, intext:<word> still forces it to always include <word> in the results.
Re:RIP Google PageRank score: A retrospective on how it ruin... by RUG3Y on Wednesday March 09, 2016 @05:50PM (#11256265)
I miss AltaVista as well. I'm a rebel and I despise Google, however effective they are. I feel like they have way too much negative influence on the web.
Re:RIP Google PageRank score: A retrospective on how it ruin... by sullivandanny on Wednesday March 09, 2016 @03:56PM (#11255687)
The title is about "Google PageRank score," not Google PageRank.

PageRank was one part of the reason we have a search as powerful as Google, the use of links to assign an authority score. Another big part was the use of link context -- which isn't part of PageRank but part of the overall search algorithm at Google.

PageRank score is when Google revealed those scores to the public for any page. That's not something it had to do, in order to use PageRank as part of it algorithm. But in doing so, it fueled an explosion in link spam.

Re:RIP Google PageRank score: A retrospective on how it ruin... by eevilspock on Wednesday March 09, 2016 @04:41PM (#11255936)
As the author himself (sullivandanny) replied, you misread the title.

But I will actually claim that PageRank itself is a problem not just because it is so gamed but also because web page authors link to things they find via Google, creating a positive feedback loop that undermines the very premise of the PageRank algorithm.

Search engine research had stagnated because of Google's dominance, and Google itself is not motivated to change, much as Microsoft was unwilling to evolve its cash cow. Rather than innovate in search, it spends most of its resources on ways to shore up its dominance (Google+, Android), fighting the very thing its search engine feeds (Internet garbage), and strengthening its advertising business.

Re:RIP Google PageRank score: A retrospective on how it ruin... by SixSigma on Wednesday March 09, 2016 @01:34PM (#11254766)
To fully remember the evolution of search one needs to have been over 20 in 1995 and on the internet. That's probably quite a small number of people who are now over 20 and on the internet.

Do you remember when Yahoo was a website about wrestling ?

Or when having a good section in DMOZ was important ?

Re:RIP Google PageRank score: A retrospective on how it ruin... by klenwell on Wednesday March 09, 2016 @02:04PM (#11254970)
I don't remember Yahoo being a wrestling site. But I was over 20 in '95 and I can remember the internet before Google. It was a bit of a mess. Fun and amazing and kooky. But tantalizingly frustrating if you were trying to do any focused research.

I can also remember the moment when I discovered Google. It was reading this article back in 2000 (I could have sworn it was 1998):

http://www.newyorker.com/magazine/2000/05/29/search-and-depl...

If you want to travel back in time to the internet as it was when Google appeared, give it a read.

For any gripes I may have about Google's search engine (like the fact I can never seem to easily relocate this article when I want to refer to it), it definitely solved more problems than it created.

Re:RIP Google PageRank score: A retrospective on how it ruin... by recursive on Wednesday March 09, 2016 @01:46PM (#11254851)
> Do you remember when Yahoo was a website about wrestling ?

What? Really? I was around in 1995, and I don't recall that...

Re:RIP Google PageRank score: A retrospective on how it ruin... by bryanlarsen on Wednesday March 09, 2016 @01:56PM (#11254919)
Jerry Wang had a webpage about wrestling that was hosted on the same server as "Jerry's Guide to the World Wide Web", the original name for Yahoo!.
Re:RIP Google PageRank score: A retrospective on how it ruin... by kofejnik on Wednesday March 09, 2016 @04:10PM (#11255755)
i remember it being akebono.stanford.edu
Re:RIP Google PageRank score: A retrospective on how it ruin... by pknerd on Thursday March 10, 2016 @02:08AM (#11257731)
immune to Google I guess
Re:RIP Google PageRank score: A retrospective on how it ruin... by cookiecaper on Wednesday March 09, 2016 @03:13PM (#11255447)
I think the problem is that Google puts too much faith in algorithms. A lot of math guys do this; they write an algorithm and are very slow to accept it when the algorithm isn't all-encompassing or totally representative. They need to give more emphasis to human tweaks and consensus, even when their algorithm is trying to figure out consensus, as PageRank does.

I'd like to see a hybrid of the high-speed algorithmic scanning of the pages that we see now combined with an army of human reviewers, including super-reviewers who are recognized industry experts, who periodically rate indexed content based on quality. Backlinks and other derived consensus measurements should be given far less weight and a combined algorithmic and human quality rating should be of at least equal importance.

So I want to go back to the days of a manually curated web index, combined with the technology needed to make that span out over billions of web pages.

Re:RIP Google PageRank score: A retrospective on how it ruin... by richardwhiuk on Wednesday March 09, 2016 @03:43PM (#11255610)
If you think that's a viable proposition feel free to start it. I'm not convinced that the economics add up, nor that recognized industry experts want to spend the majority of their time reading a huge amount of content and rating it for pennies an hour.

I don't think Google have too much faith in their algorithm - they know it's flawed. But it's the least worst algorithm anyone has come up with, and adding human tweaks leads it subject to subjective bias.

Re:RIP Google PageRank score: A retrospective on how it ruin... by cookiecaper on Wednesday March 09, 2016 @03:55PM (#11255677)
>If you think that's a viable proposition feel free to start it.

Yeah, I don't think it's a bad idea. I don't have the funding to start it, of course, and VCs crap their pants at the thought of anything that has overhead, so it's probably a non-starter.

>nor that recognized industry experts want to spend the majority of their time reading a huge amount of content and rating it for pennies an hour.

The recognized experts would be paid more than pennies an hour, and they wouldn't need to spend the majority of their time reviewing content. They'd be "super-reviewers", so their opinions would hold a lot of weight. It'd be a way for them to make some extra money without a lot of overhead, something they'd do occasionally for an hour here and there. Honestly the main thing we'd be looking for from these people is information about the cutting edge; things that are trending that we haven't picked up yet, things that are new and thus don't have a lot of consensus markers but are still worth attention, and information about the perception of the content within the industry. That classification can be used to inform on a variety of axes that could be good search parameters. We'd need to make sure we got opposing industry leaders so that the index didn't become solely representative of a single viewpoint.

Normal reviewers in a position analogous to a news reporter are more affordable, more consistent, and can classify the majority of content for a sector fine. Maybe Yahoo! could take their niche content mills and reassign the staff to rate pages in their index, then maybe their search will get somewhere.

Then you'd have MTurk style reviewers who provide the bulk of the content rankings and just give back a few basic pieces of info. These are the people that would be working for $2-$3/hr or less, at their convenience.

All of this is on top of a more traditional automated ranking algorithm that would use consensus markers and computer-perceptible quality markers to rank content. There's not necessarily an obligation that every page is sampled and reviewed by a human.

It'd be great if we could get good traffic data too; we'd be able to see where people are actually going instead of just what they put links back to.

>But it's the least worst algorithm anyone has come up with, and adding human tweaks leads it subject to subjective bias.

The bias is there regardless, it's just filtered through different parameters. This is inescapable. In general, not just in algorithm and computer design, we need less faith in cold systems and more faith in human intervention and judgment.

Yes, you have to be aware that any process is subject to gaming, manipulation, or bias, but I think affording sufficient room for human opinion and circumstantial judgment as very highly-weighted inputs prevents most of the egregious failures caused by runaway systems.

Re:RIP Google PageRank score: A retrospective on how it ruin... by privatoro on Friday March 11, 2016 @04:46AM (#11265659)
@cookiecaper: Something like what you describe is happening.