News for hackers. Stuff that matters.

A comment on Google may rank sites for queries that don't appear on the page at all. Parent comment

Re:Google may rank sites for queries that don't appear on th... by SeanDav on Thursday March 21, 2019 @10:19AM (#19452613)
I would so love access to Google database, but with Boolean search and some simple Regex / Grep type functionality. We can but dream.
[ Parent | on HN ]
Re:Google may rank sites for queries that don't appear on th... by rvnx on Thursday March 21, 2019 @10:44AM (#19452890)
The closest to this is to use BigQuery over HTTPArchive, it's not the Google index but a pretty solid base though and requires no setup at all.

https://github.com/HTTPArchive/legacy.httparchive.org/blob/m...

You can search for anything in the source-code of pages, using any regex or grep you can imagine.

[ Parent | on HN ]
Re:Google may rank sites for queries that don't appear on th... by londons_explore on Friday March 22, 2019 @01:54AM (#19459944)
Get a job at Google and then you can directly query the underlying data with as complex a query as you like (and don't have to use indexes etc).

Obviously running your custom filter logic across every byte of data that has ever existed on the internet is compute heavy... But Google has lots of that!

[ Parent | on HN ]