News for hackers. Stuff that matters.

A comment on ‘You Could Look It Up’: The World Before and Since Wikipedia. Parent comment

Re:‘You Could Look It Up’: The World Before and Since Wikipedia by jgalt212 on Sunday February 21, 2016 @02:48PM (#11146134)
This is interesting. On a related note, how come I've never seen britannica.com in my Google search results?

Their robots.txt file doesn't scream crawlers go away.

http://www.britannica.com/robots.txt

[ Parent | on HN ]
Re:‘You Could Look It Up’: The World Before and Since Wikipedia by dazc on Sunday February 21, 2016 @06:39PM (#11147274)
Interesting point.

Their first article is about 100th Anniversary of the Battle of Verdun so I search "Battle of Verdun" and their page, in the UK, is #15.

Looking at site overall I think this is a fair result?

Maybe demonstrates that results on page 2 are generally overlooked/rarely seen?

[ Parent | on HN ]
Re:‘You Could Look It Up’: The World Before and Since Wikipedia by dpc59 on Sunday February 21, 2016 @10:40PM (#11148274)
I wonder what would happen if google added 50% more results per page.
[ Parent | on HN ]