News for hackers. Stuff that matters.
Re:When Yahoo Ruled the Valley: Stories of the Original ‘Sur... by gkop on Saturday July 16, 2016 @01:41PM (#12107160)
Where does human curation of the web live now? Is it all temporal (Reddit, Facebook, Twitter, HN, etc), or is there somewhere central that humans organize it "for all time"? Would a modern Yahoo with the staff surfers replaced by the crowd provide value to the world? Could it possibly work without being horribly gamed? Are there good examples of having tried this idea?
Re:When Yahoo Ruled the Valley: Stories of the Original ‘Sur... by pavlov on Saturday July 16, 2016 @02:00PM (#12107269)
Pinterest is more curation-oriented than the other social networks... And Wikipedia of course functions as a sort of directory for many topics.
Re:When Yahoo Ruled the Valley: Stories of the Original ‘Sur... by holdenc on Saturday July 16, 2016 @03:16PM (#12107523)
That Yahoo took so long to give up the DMOZ directory-style mentality is just another example of technologists favoring a neatly ordered solution over an organic one. In the crowd-sourced organic model, there is less curation, and more a time-based record of fleeting curiosity.
Re:When Yahoo Ruled the Valley: Stories of the Original ‘Sur... by dredmorbius on Saturday July 16, 2016 @07:08PM (#12108226)
Curation worked, early, in that there was relatively little online content. As late as 1998, the quality content online was perhaps 10,000 books:

Despite the hype, the Web just isn't all that impressive as an information resource. The static, publicly accessible HTML text on the Web is roughly equivalent in size to a million books. The UC Berkeley Library has 8 million volumes, and the average quality of the Berkeley library content is much, much higher! If 10% of the material on the Web is ``useful,'' then that means there are about 100,000 useful book-equivalents on the Web, which is the size of good public library. The actual figure for ``useful'' is probably more like 1%, which is 10,000 books, or half the size of an average mall bookstore.

http://people.ischool.berkeley.edu/~hal/Papers/japan/index.h...

I'm leaning strongly toward curation via tagging, using standard ontologies, and vetted through designated / qualified experts for top content. A mix of crowdsourcing and expertise seems most viable.

Quasi-related -- a rant on Pocket suggesting improved "tags" functionality (I swear there's another, better, though I cannot find it in the usual places).

https://ello.co/dredmorbius/post/3eucmp_s0tumjuoxmfclbw

Re:When Yahoo Ruled the Valley: Stories of the Original ‘Sur... by naveen99 on Saturday July 16, 2016 @09:36PM (#12108650)
Maybe, but the web lets you ask questions for which there is no answer yet. But you might get one tomorrow once you ask.

Also youtube is an amazing resource that books can't compete with.

Tags and ontologies also can't compete with search, Bigquery and data lakes.

Re:When Yahoo Ruled the Valley: Stories of the Original ‘Sur... by dredmorbius on Saturday July 16, 2016 @11:19PM (#12108886)
Read Varian's paper (above), it anticipates a great deal, especially his commentary on Gresham's Law and content. There's also one from a couple of Stanford researchers a few years back which suggest a similar problem:

Currently, the predominant business model for commercial search engines is advertising. The goals of the advertising business model do not always correspond to providing quality search to users. For example, in our prototype search engine one of the top results for cellular phone is "The Effect of Cellular Phone Use Upon Driver Attention", a study which explains in great detail the distractions and risk associated with conversing on a cell phone while driving.... It is clear that a search engine which was taking money for showing cellular phone ads would have difficulty justifying the page that our system returned to its paying advertisers. For this type of reason and historical experience with other media [Bagdikian 83], we expect that advertising funded search engines will be inherently biased towards the advertisers and away from the needs of the consumers.

http://goo.gl/CTwEmw

Including in my tagging schemas for Pocket are quality indicators. I've been using an arbitrarily selected ranking scale of "a-1, a-2, ... a-5" to indicate quality (higher is better), and also tagging items with keywords indicating negative attributes (usually "bullshit", though others apply).

Being able to group classifications by reputation of author or publisher is also a key element. While there are hazards in argument from authority, there are frequently benefits both to recognising expertise and identifying non-credible or impeached sources. If a source routinely pursues some objective rather than the truth, you might tend to question its value.

PageRank essentially relies on the implicit reputation vetting of links, using link sources as a basis for quality assessment. It's useful but also limited. And as noted, the bias toward advertising and specific gain (see also Celine's 2nd Law, from Robert Anton Wilson's "Illuminatus" trilogy) raises issues.

I've been doing significant amounts of research, much of it online, but much also tracking down published book and article sources (most of those through illicit download sites -- really the only way the information can be obtained reasonably), and what I'm finding is that the noise associated with online data is just boggling.

Books, it turns out, compete exceptionally well with YouTube. Ultimately they compliment one another. Sometimes I want to read, sometimes I want a lecture or demo. Both have their place.

Excessive data ultimately isn't illuminating.

Yes, online search can be useful at finding out, say, what's happening right here, now (transit applications are a huge one), or within a given social circle, but both of those are domains in which an exclusion scope is set which rules out virtually all available results -- you're looking for information about a specific location and time, or concerning a specific group of people.

When it comes to general information, "reliable sources" dwindle. If you're looking for some established authority or text, you're left with the specific sources. If it's news, typically you're going to want some vetted news source -- and yes, that includes informally vetted sources on Twitter or YouTube. One of the most annoying things about both sources are the crap leaches who instantly show up to clog any trending keyword topic with crap content. That shit's got to get stomped hard.

For new and developing information, ways to broadly pre-filter and bubble up quality content are an interesting problem and one I'm actively working on. Community rather than broadcast methods strike me as more viable.

Re:When Yahoo Ruled the Valley: Stories of the Original ‘Sur... by personlurking on Saturday July 16, 2016 @03:07PM (#12107496)
I wonder what value such curation has in today's terms, even if it were for a niche category. Plus, how does a modern 'surfer' know what they don't know (a site that should be included but they haven't come across it yet)?

Also, I wouldn't imagine there to be any sort of IP to such an idea, as the sites listed belong to other people/companies.

Re:When Yahoo Ruled the Valley: Stories of the Original ‘Sur... by wsterling on Saturday July 16, 2016 @04:41PM (#12107814)
"Plus, how does a modern 'surfer' know what they don't know (a site that should be included but they haven't come across it yet)?"

Yahoo had a form that allowed you to submit your site to be added to the directory. You included the URL and categories you would like to be listed in. It would then be evaluated and added by a Yahoo employee. It was one of the first things I would do after creating a new web site in the early 90s.

Re:When Yahoo Ruled the Valley: Stories of the Original ‘Sur... by firasd on Saturday July 16, 2016 @03:01PM (#12107473)
Interesting to ponder. I'm working on an app for podcast discovery (think Youtube for podcasts; I've put the twitter link in my HN profile page if anyone is interested in updates) and I've been thinking about this. I am generally anti-curation in my current approach. In this context I don't like the concept of people asking you to upvote something on Product Hunt, or leave a review on iTunes so it filters to the top of the list and gets some editor's attention, etc. I kinda prefer the Netflix or Youtube approach that tries to figure out what you'd like based on your viewing history, or items related to what you're viewing, or what other people who like what you're viewing have also liked... (Related, I also don't like the idea of 'categories' where you have to select whether an item is 'History' or 'Politics'. I'd like my software to be able to group items intelligently without manual intervention...)

So in a way, with something like the way Netflix replaced explicit star-ratings based recommendations with viewing-history based recommendations, we are still looking for curation but in a subtler, more algorithmic way... same with Google PageRank and Facebook Newsfeed for that matter. Maybe algorithmic filtering is just curation at scale.

Re:When Yahoo Ruled the Valley: Stories of the Original ‘Sur... by Broken_Hippo on Saturday July 16, 2016 @04:25PM (#12107761)
I wish you luck. I prefer these sorts of curations much better than piecing together things based on reviews. I haven't had Netflix for years: Youtube can be fairly pleasant, until I click on something that "poisons" the feed. Surprisingly, Spotify does fairly well on recommendations for me, considering I have eclectic and sometimes unpopular listening habits. I'd consider the app you are working on :)
Re:When Yahoo Ruled the Valley: Stories of the Original ‘Sur... by dredmorbius on Saturday July 16, 2016 @07:04PM (#12108211)
On YouTube:

1. Deleting from history any "poison" content -- generally, stupid shit -- "that corner of YouTube" stuff, helps.

2. I've largely abandoned logged-in use of YouTube for numerous reasons. Its app is all but unusable due to pre-roll ads. (Tasteful banners I can stomach.). Routinely purging all history, and/or resetting device ID helps.

3. Purposeful and directed use of YouTube, or, frankly, any other service, is best. Search for what you're interested in and read/view that. Much of my use is autodidactic and informational. There's actually a wealth of information online now, if you can filter out the crud.

4. Being able to blacklist the stupid shit channels would help a hell of a lot. If I could personally banish to the depths of Hades any channel that posted stupid crap, things would be markedly improved.

Re:When Yahoo Ruled the Valley: Stories of the Original ‘Sur... by Broken_Hippo on Sunday July 17, 2016 @12:14PM (#12110610)
I do some of these from time to time, and weirdly, the 'back' button on the browser helps temporarily.

#3 is my usual mode for initial watching, but I'm prone to go with suggestions from that when I'm watching. Sometimes, even with best intentions, it gets messy.

Number 4, that would be most excellent. :D

Re:When Yahoo Ruled the Valley: Stories of the Original ‘Sur... by dredmorbius on Sunday July 17, 2016 @05:08PM (#12111826)
If you're on desktop, installing Stylish and removing YouTube's comments and Suggestions panes is a huge win. You'll still see suggestions in-video, but those are slightly less annoying.

(I've also noticed that, well fed and pruned, YouTube's suggestions actually tend toward useful these days, though that's with exceptionally aggressive pruning.)

Yet another option is to use youtube-dl to download and play content locally. I do this pretty much exclusively on desktop, and find it quite helpful.

Re:When Yahoo Ruled the Valley: Stories of the Original ‘Sur... by city41 on Saturday July 16, 2016 @04:00PM (#12107653)
Delicious in its heyday would have qualified as a crowd sourced directory.
Re:When Yahoo Ruled the Valley: Stories of the Original ‘Sur... by agumonkey on Saturday July 16, 2016 @06:39PM (#12108149)
I kinda abuse reddit as a vetted public bookmark service.
Re:When Yahoo Ruled the Valley: Stories of the Original ‘Sur... by empath75 on Saturday July 16, 2016 @02:32PM (#12107368)
Dmoz still exists and is still run by AOL.
Re:When Yahoo Ruled the Valley: Stories of the Original ‘Sur... by dredmorbius on Saturday July 16, 2016 @08:05PM (#12108375)
Indeed it does. I'd forgotten it was AOL that ended up with it though, that's rather discordant.
Re:When Yahoo Ruled the Valley: Stories of the Original ‘Sur... by avar on Saturday July 16, 2016 @03:46PM (#12107614)
The right answer to this is Google: You can search for any combination of things you want from any time. No need for a centrally maintained directory.
Re:When Yahoo Ruled the Valley: Stories of the Original ‘Sur... by dkarapetyan on Saturday July 16, 2016 @03:56PM (#12107641)
Google is not the right answer. Far from it. Lack of imagination is what makes it the de-facto standard. Why do I need a centralized body to do filtering and curation? Why can't it be a collaborative effort augmented with some machine learning? People should be in charge of their own information bubbles.
Re:When Yahoo Ruled the Valley: Stories of the Original ‘Sur... by avar on Saturday July 16, 2016 @04:57PM (#12107855)
I don't mean that Google literally 100% replaces that use-case, but that the answer is that search engines got good enough that directory curation was no longer marketable.

So nowadays what you'd previously look up in something like dmoz you now just search for in Google.

Re:When Yahoo Ruled the Valley: Stories of the Original ‘Sur... by Spooky23 on Sunday July 17, 2016 @12:10AM (#12108994)
Google was magic in 2001. Today, it's impossible to find many categories of information. That's why stack exchange exists.

When I'm doing market research or looking for certain types of information, being aware of forums like HN is more productive.

Long term the movement of everything behind walled gardens like Facebook will make it worse.

Re:When Yahoo Ruled the Valley: Stories of the Original ‘Sur... by DanBC on Saturday July 16, 2016 @05:53PM (#12108023)
Google is great. It's also given us a billion shitty SEO optimized sites that hit keywords but provide little value.
Re:When Yahoo Ruled the Valley: Stories of the Original ‘Sur... by cvs268 on Saturday July 16, 2016 @07:10PM (#12108233)
Well, there"s Wikipedia...