News for hackers. Stuff that matters.
Re:Show HN: Tuchu – Automatically highlight the important pa... by heresjohnny on Monday December 28, 2020 @06:48AM (#25558491)
Hey HN,

I created Tuchu because I wanted to increase my reading efficiency. It is a tool that automatically highlights the important parts of any document. Most documents take about two to three seconds to process. It's directed at students, researchers, or anyone with a reading list and little time for that matter.

During my studies I had to go through a lot of literature, for example when I had to select relevant material for my thesis, or when I had to familiarize myself with a course's reading list. Tuchu helped me to get up to speed in these cases. What started off as a command-line Python script is now a web application that does its analysis without any back-end. I don't get to see your documents.

The underlying algorithm that selects what's relevant is called TextRank, an unsupervised summarization method [1]. It models a document (or a collection thereof) as a fully connected graph. Its nodes are parts of the text — I use sentences — and the edges between them are weighted by a similarity measure, in my case simple word overlap. The subset of sentences with the highest PageRank are then highlighted. For good measure, I also highlight sentences that contain signal words that — in my academic experience — signify importance.

It's important to note that Tuchu is not a substitute for doing your own reading. It could make you a faster reader by directing your attention to the important parts, but you'll still have to ponder about the true essence of a document yourself.

[1] https://www.aclweb.org/anthology/W04-3252/

Re:Show HN: Tuchu – Automatically highlight the important pa... by rdhyee on Monday December 28, 2020 @03:24PM (#25562831)
Very interesting. I'd love a way to download a highlighted version of the PDF that I fed to Tuchu.

I uploaded a PDF version of a Wikipedia article to see what was selected, and at a quick glance, it's not obvious to me that the most important parts of the article have been highlighted. On the other hand, it's not obvious that trivial parts have been selected either -- leaving me intrigued to look further.

Re:Show HN: Tuchu – Automatically highlight the important pa... by aquajet on Monday December 28, 2020 @05:26PM (#25564003)
I made a similar site to Tuchu a while ago that attaches the highlights to the pdf: https://anishthite.github.io/ailight/. It's a bit slow though, I've been trying to get it to run faster.
Re:Show HN: Tuchu – Automatically highlight the important pa... by krat0sprakhar on Monday December 28, 2020 @01:37PM (#25561782)
Looks interesting! Is there a way to try it out on a webpage instead of PDF?
Re:Show HN: Tuchu – Automatically highlight the important pa... by quaintdev on Monday December 28, 2020 @01:50PM (#25561944)
This kind of service would be amazing with a browser extension.

Nowadays a lot of bloggers/reporters keep running round in circles before coming to a point. I actually wrote a post related about this a while back [0]. With browser extension this can save lot of time of readers. Heck I would pay for such a service!

[0]: https://www.ankshilp.com/stop_beating_around_the_bush/

Re:Show HN: Tuchu – Automatically highlight the important pa... by heresjohnny on Tuesday December 29, 2020 @04:36AM (#25568196)
Hi krat0sprakhar,

At this point you could print the page to a PDF and then upload it. A browser extension for webpages (as suggested by others) is a good idea! I'll look into it.

Re:Show HN: Tuchu – Automatically highlight the important pa... by donclark on Monday December 28, 2020 @02:24PM (#25562300)
I agree as well. This may have a 2nd life as a browser extension to use on articles on the web.
Re:Show HN: Tuchu – Automatically highlight the important pa... by sologuardsman2 on Monday December 28, 2020 @02:30PM (#25562359)
+1 to the browser extension idea
Re:Show HN: Tuchu – Automatically highlight the important pa... by donclark on Monday December 28, 2020 @02:23PM (#25562292)
I dont have a PDF laying around that I could test it with. It would be nice if you had an example link to a PDF, or screenshots showing an example of the highlighting that the service does.
Re:Show HN: Tuchu – Automatically highlight the important pa... by yorwba on Monday December 28, 2020 @03:18PM (#25562764)
The background image with the stylized images of highlighted documents is an ideal candidate for replacement with a screenshot of actual highlighted documents.
Re:Show HN: Tuchu – Automatically highlight the important pa... by iav on Monday December 28, 2020 @09:13PM (#25565910)
Dude! This is super helpful. I run a website with millions of huge text PDFs and thousands of users, and being able to implement this will literally save my users man years of time.
Re:Show HN: Tuchu – Automatically highlight the important pa... by heresjohnny on Tuesday December 29, 2020 @04:31AM (#25568172)
Hey iav,

Cool! Would love to hear more. Perhaps you could reach out at [email protected]? :)

Re:Show HN: Tuchu – Automatically highlight the important pa... by ArubaJamaica on Tuesday December 29, 2020 @07:20AM (#25569047)
Curious to know what website this is
Re:Show HN: Tuchu – Automatically highlight the important pa... by iav on Tuesday December 29, 2020 @10:51AM (#25570910)
bankrupt11.com
Re:Show HN: Tuchu – Automatically highlight the important pa... by karthikb on Monday December 28, 2020 @05:25PM (#25563992)
How did Tuchu's highlighting compared to the abstract?
Re:Show HN: Tuchu – Automatically highlight the important pa... by giovannibonetti on Monday December 28, 2020 @08:22PM (#25565528)
Does It support other languages than English?
Re:Show HN: Tuchu – Automatically highlight the important pa... by jhvkjhk on Monday December 28, 2020 @11:24PM (#25566701)
I tested with a 26 pages Chinese pdf and the answer is no, Tuchu only highlighted three English sentences.

This is weird, as Tuchu means highlight in Chinese.

Re:Show HN: Tuchu – Automatically highlight the important pa... by heresjohnny on Tuesday December 29, 2020 @04:29AM (#25568164)
Hi jhvkjhk,

Thanks for your feedback. In theory all languages should be supported since TextRank should be language-agnostic. Having said that, I think that my current sentence similarity strategy (by word overlap) is not a good fit for "symbol rich" languages such as Mandarin.

I am not Chinese (or from Asian descent) myself. Tuchu comes from some rainy Sunday Google translating. ;)