News for hackers. Stuff that matters.
Re:Google emphasizes popularity over accuracy by jkaptur on Wednesday April 01, 2020 @12:00AM (#22745516)
Yeah, I'm sort of surprised that there isn't a semi-popular "web grep" tool for people who would rather use regex, some understandable ranking algorithm with knobs to tweak, etc.

Of course, you'd have to read a manual to use it and it would have a ton of spam, but some people just want lower-level control - they still sell stick-shift cars.

Re:Google emphasizes popularity over accuracy by zo1 on Wednesday April 01, 2020 @02:59AM (#22746384)
Not just that, but the sheer scale of such an index. The size of the web now just makes anything small next to impossible without a lot of funding. And none of the existing search engines will probably allow you programmatic/data access to their index without a metric ton of cash
Re:Google emphasizes popularity over accuracy by artificial on Wednesday April 01, 2020 @03:23AM (#22746503)
How is it that spiders/bots are able to "index" copyrighted content? Is it just one of those things where the ends justify the means or a holdover/tradition or some such?
Re:Google emphasizes popularity over accuracy by kd5bjo on Wednesday April 01, 2020 @03:47AM (#22746603)
It’s some combination of fair use and raw data not being copyrightable. My understanding is that only the creative expression that’s copyrighted, and not the actual words. So, if you distill out all of the creativity into something that’s purely information about the work, you’re probably fine copyright-wise.

There’s a long tradition of compiling and publishing concordances, which are just indices of every place each word appears in the original text. They’re generally not useful without access to the original, so noboy seems to mind them very much. Google’s index is just a modern form of the same thing.

Re:Google emphasizes popularity over accuracy by sefrost on Wednesday April 01, 2020 @03:05AM (#22746413)
I wonder how many pages would be worth indexing for such a tool though.
Re:Google emphasizes popularity over accuracy by zo1 on Wednesday April 01, 2020 @08:22AM (#22747883)
Probably a tiny subset. But the problem is finding that small subset!