Re:The coming tsunami of fakery
by ihateolives on Thursday August 25, 2022 @11:00AM
(#32594562)
Refreshed few times. 99% of sites were about IT, programming, gaming, tech, STEM in general. That's really narrow representation of internet. Maybe it's just my luck.
[ Parent
| on HN ]
Re:The coming tsunami of fakery
by marginalia_nu on Thursday August 25, 2022 @11:05AM
(#32594650)
Turns out, people who make websites are usually the sort of people who make websites.
Re:The coming tsunami of fakery
by ihateolives on Thursday August 25, 2022 @11:51AM
(#32595437)
That's the problem with the approach you've taken. You're showing domains, not web pages. Not all hobbyists or interest groups outside tech have domains.
You can always contribute by crawling ipv4 range searching for http servers that don't necessarily have a domain pointing at them and posting a list for us when you're done crawling it merely once :)
I'm assuming you're referring to Facebook groups or similar walled-garden web presences? If so, I'm assuming indexing those is an explicit non-goal for OP, and I'd agree with that. The walled gardens are very hard to index (often actively hostile), which means the returns would be rather low. Plus, most such places have searches of their own if you're really interested in finding something there.
Re:The coming tsunami of fakery
by harimau777 on Thursday August 25, 2022 @12:45PM
(#32596375)
In my experience, part of the problem is that often (usually?) the search on those places is nearly useless. For example, I shudder to think what will happen if old.reddit ever stops working.
True, but for reddit adding "reddit" to a google search does just fine. Not so much for the single-purpose websites marginalia focuses on.
Re:The coming tsunami of fakery
by marginalia_nu on Thursday August 25, 2022 @08:16PM
(#32601757)
Well the literal point of the tool is to show that there are websites outside of the walled gardens. There are plenty of link aggregators already. Hacker News is one of them. Reddit is another. Twitter is a third. Google is a fourth.
Re:The coming tsunami of fakery
by forbiddenvoid on Thursday August 25, 2022 @11:38AM
(#32595195)
This is basically the late 90s internet in a nutshell.