News for hackers. Stuff that matters.

A comment on Show HN: TorrentPeek – Distributed search engines using BitTorrent and SQLite.

Re:Show HN: TorrentPeek – Distributed search engines using B... by tombert on Monday April 17, 2017 @01:10PM (#14132581)
This reminds me a lot of the (I think) very underrated YaCy project: http://yacy.net/en/index.html

I know there are a ton of technical reasons why this is difficult, but web-scraping and the like always seemed like a problem that could be done fairly elegantly with distributed systems.

[ Parent | on HN ]
Re:Show HN: TorrentPeek – Distributed search engines using B... by j3097736 on Monday April 17, 2017 @04:00PM (#14133939)
AFAIK YaCy "peers" are just instances of solr doing search/indexing on their own (as set by the user) and the "distributed search" page only redirects the user to one of the available peers with external port open, not much p2p going on.

It requires a lot of resources with little to show for it.

[ Parent | on HN ]
Re:Show HN: TorrentPeek – Distributed search engines using B... by feadog on Monday April 17, 2017 @01:38PM (#14132834)
web-scraping and the like always seemed like a problem that could be done fairly elegantly with distributed systems.

Elaborate?

[ Parent | on HN ]