Newser[2] tried to do the same thing but gave up and just focused on in-house created summaries.
Regarding the summary process, it's good to see another group manually summarizing posts as opposed to Summly[3] which tries automate the process. For many reasons already stated in another comment[4], I don't think automation will ever work.
Good luck to the guys over at http://toolong-didntread.com and http://newspaper23.com. I hope one of us gets some real traction!
[1] http://skimthat.com [2] http://www.newser.com/ [3] http://summly.com/ [4] http://news.ycombinator.com/item?id=4741855
Edit: Another product that tries to summarize news http://cir.ca/
http://skimthat.com/4407/ind-home-explosion-now-homicide-inv...
It could have been summarized down to something like: Rumors are circulating that a suspicious white van was parked in front of the house that blew up.
I would rather it be super short with just the important fact. If it peaks my curiosity, then I'll click to the full article.
I don't know, that's just my opinion.
Our goal is to give the reader a good understanding of the topic while leaving out the unnecessary details and redundant information. The original had 465 words. That means that the Skim That summary cut the story down by over 50% while still giving you a strong overview of the story.
Here's why: Let's assume we have the perfect algorithm that knows exactly which sentences to pick for a good summary. You'll still end up with a summary that's horribly out of context and difficult to read.
Try it yourself. Assume your brain is the perfect algorithm and pick the most important sentences for a summary. Then try to read just the sentences that you picked without rewriting it into a coherent paragraph. More than likely, it'll be an out of context confusing block of text.
Algorithms will never solve the summarizing process unless they are teamed up with a rewriting engine that could build coherent paragraphs.
> Algorithms will never solve the summarizing process unless they are teamed up with a rewriting engine that could build coherent paragraphs.
That doesn't sound like never. Frankly, I wouldn't be surprised if such AI would created within 50-100 years, ie in my lifetime. I think this comment exposes the common false thought-pattern that if something is not viable in the next quarter, then it'll never happen.
I know if I wrote a summary of a Microsoft Surface article (I have one), it'd be very different from someone who loves it -- or is even an MS employee.
And spam... big issue there.
(disclaimer - I have your plugin and have tried it, summaries seem way too short.)
You should have a few links listed on that page that you know will work well as examples for people to try the service out with.
Btw, how do you feel about my other comments in this thread about algorithms not working well? My basic point is that they will most likely produce paragraphs that are out of context.
Disagree - having written a bunch of these gist extractors I have found that the good ones do not produce out of context paragraphs. In fact, that's pretty much the point - to find the salient portion of the content.
They are out of context because they (we) are basically just doing extraction. In which we just extract the most important sentences, arrange them in order, and present it in a paragraph / list. I prefer presenting the top sentences in a list though. In my opinion, presenting it as a paragraph will make an effect that it's out of context rather than in a list.
If the summaries was done through abstraction, like how humans are doing it, it will obviously produce better summaries. But why we are not doing it? I believe abstraction summaries are holy grail of automatic summarization.
In the meantime, I created a list[1] of popular stories from Reddit news sources. Each story links to a special hybrid page that allows you to write a summary on top while you read the story below.
[1] http://skimthat.com/unsummarized
edit: clarification
I really like how it uses line by line bullet point fields to help write the summary. I experimented with something like that in the past. It kind of works but it isn't as smooth a read as a paragraph of text but it does make the writing process easier.
It seems that I helped inspire you nonetheless, which is great of course!
As for what makes tldr.io great; it's mostly the Chrome plugin which adds TL;DR icons next to the links on Hacker News.
They still need to work on enticing more users to contribute back though.
Isn't it possible to discuss the merits of the product provided in the opening post without one-line nonsense posts spamming your own thing?
JEEZUZ.
What many people underestimate is that summaries have an inherent problem: bias. No two people are ever going to summarize an article the exact same way - much less so when it comes to politics etc. So before I use a site to read summaries, I have to trust the brand (I trust The Economist, for they mostly differentiate between reporting and editorializing) and I will never ever trust an anonymous bunch of people (the "crowdsourcing" summaries-solution) to accurately summarize without bias. I value as-close-to-objective-reporting-as-possible very highly - judgments I can make my own.
Phase 1: The MVP of a news aggregator should be a curated/editorial like traditional media/magazines, etc [1]
Phase 2: The second stage should be to have submissions from your readers (on content that interests them).
Phase 3: The next would be to have a voting mechanism, and then realizing that articles have different relevance in different communities - which is what prismatic and ypander were aiming to solve.
Full Disclosure: I am working on summarizing technology news, and the tagline so far has been "Hacker News on Steroids." Before it gets to that stage, I'm skimming my most favourite feeds from Google Reader. The best mobile wrapper I've found (since I'm targeting mobile as well) has been Feedly, which presents it as more like a magazine. Keep in mind Feedly didn't start out as this 4 years ago.
Another project aiming to solve this problem with a bookmarklet (and has a more appt domain name imo is tldr.io) though I personally haven't used it. Summly is another one, but after using it for a while, I found Feedly much better suited to my reading habits.
I'd love to team up with others who are working on this problem. My MVP is at http://dinopost.com. Drop me a line at aaron at dinopost.
[1] Phases based on Casey Accidental's blog post: Online News is Broken: http://caseyaccidental.com/online-news-is-broken/
full disclosure: i'm one of the cofounders
I'm guessing it has to do with column width and coloring.
But it scales nicely out to a tablet. And a phone. Part of the initial appeal for my writing it was to download all of the daily commentary as json to my tablet. Then I could walk around town and such without having to worry about an internet connection. The idea was -- how much real static text do you consume in a day? Can't be more than 100 or so articles. So why not just download the plain text and consume it at your leisure?
Another feature I wanted was the ability for people peering over my shoulder to NOT be able to tell what I was consuming. Many times at work or on the train I'd have some time to read commentary, and the last thing I wanted to do was load up a page with a branded look and feel. I wanted the plainest amount of pure text possible.
I appreciate the feedback. Although I use it daily, it's not high on my list of priorities. Next up I think I'll double the amount and type of content. Maybe after that I'll go back to the UI for some rework. For me this is more of a personal thing than a business feeler. So even if nobody else in the world likes it, I'm good. :)
Initially it's just an aggregator that presents commentary in plain text. I plan on adding a summarizer one day. For a personal project, I've been using it daily for over a year, so I know I find a lot of value in this type of thing.
As sites try to get more sticky, the signal-to-noise ratio decreases. You spend more time reading a lot of trivial articles that a Facebook friend recommended instead of a few articles that you've scanned yourself. I know Google and FB say social search is the cool thing, but in my experience the only thing it does is increase consumption of mediocre shiny stuff. Much better to pre-qualify sources and then control the depth of your dive. For newspaper23, one of the original ideas was a timer for each day. 30 minutes of scanning and the site would refuse to load until the next day.
I'd like to see more of this type of thing -- gearing content consumption to humans instead of site creators and advertisers.