News for hackers. Stuff that matters.
Re:Top Books on Amazon Based on Links in Hacker News Comments by _lpa_ on Monday January 18, 2016 @12:01PM (#10925434)
I did something pretty similar over christmas, though I used named entity recognition to extract book titles rather than looking for amazon links, and (so far) also limited it to specific "Ask HN" threads about books. You can find it here: http://www.hnreads.com/. It is interesting to see how little overlap there is between the two, though that may be due to my using far fewer (and also newer) threads!
Re:Top Books on Amazon Based on Links in Hacker News Comments by bitcointicker on Monday January 18, 2016 @04:05PM (#10926934)
Surprised to see Permutation City in that list. Given that the book is written in 1994, Gregg displays admirable prescience about how computing would develop. Honestly you would think it was written in the last 5 years or so. His vision of cloud computing is absolutely outstanding. It blew me away when I checked when the book was written after reading the first few chapters.

I'd read Schild's Ladder prior to reading Permutation city, which is also a good read. It does seem to get bogged down in the technical and descriptive side of things at times, however, it's a fantastic idea for a story. The main premise of the film would make a great movie.

Whilst I'm on the subject of good "Hard sci-fi" novels, Tau Zero is also worth reading.

Edit - I'll also throw this in: http://www.amazon.co.uk/gp/product/0814703259

Magic :-)

Re:Top Books on Amazon Based on Links in Hacker News Comments by jcrites on Monday January 18, 2016 @08:32PM (#10928326)
If you like Permutation City, you might also enjoy another of Egan's works, Diaspora. http://www.amazon.com/Diaspora-Novel-Greg-Egan/dp/1597805424...

"Since the Introdus in the twenty-first century, humanity has reconfigured itself drastically. Most chose immortality, joining the polises to become conscious software. Others opted for gleisners: disposable, renewable robotic bodies that remain in contact with the physical world of force and friction. Many of these have left the solar system forever in fusion-drive starships.

And there are the holdouts: the fleshers left behind in the muck and jungle of Earth—some devolved into dream apes, others cavorting in the seas or the air—while the statics and bridgers try to shape out a roughly human destiny."

Egan's books have been some of the most thought-provoking I've ever read as far as science fiction technology. A lot of the works were out of print until recently; I'm glad to see there's been a resurgence of interest in his writing, and the availability of his works.

Re:Top Books on Amazon Based on Links in Hacker News Comments by ngoldbaum on Monday January 18, 2016 @09:33PM (#10928546)
Another Egan book well worth reading is Schild's Ladder, which reminds me a lot of Diaspora and was recently reissued in the US:

http://www.amazon.com/Schilds-Ladder-Novel-Greg-Egan/dp/1597...

Re:Top Books on Amazon Based on Links in Hacker News Comments by ChrisClark on Monday January 18, 2016 @10:41PM (#10928735)
Those are all great, in fact I'd recommend reading pretty much all of his books. I've got a shelf full of them. :)
Re:Top Books on Amazon Based on Links in Hacker News Comments by Estragon on Monday January 18, 2016 @11:02PM (#10928794)
Read the Orthogonal trilogy. I think it may be Egan's best work.

Although it's more like Schild's Ladder than Permutation City, I suppose. (Physics ideas rather than computation.)

Re:Top Books on Amazon Based on Links in Hacker News Comments by odbol_ on Monday January 18, 2016 @09:20PM (#10928501)
Cloud computing isn't really anything new. Back in the day they just called them "servers". And clients were "dumb terminals".
Re:Top Books on Amazon Based on Links in Hacker News Comments by temo4ka on Monday January 18, 2016 @01:21PM (#10925892)
Many thanks for sharing this. One usability nitpick though: please consider fixing links so that they could be opened in new tabs/windows.
Re:Top Books on Amazon Based on Links in Hacker News Comments by tedmiston on Monday January 18, 2016 @04:48PM (#10927245)
Opened 7 new tabs from the interesting books to me before I realized this didn't work too. It seems the URLs are not quite "pages" -- opening one and refreshing it redirects home as well.

Nonetheless, this is an awesome project.

Re:Top Books on Amazon Based on Links in Hacker News Comments by _lpa_ on Monday January 18, 2016 @05:05PM (#10927354)
Yeah this is my mistake - sorry :(. I'll fix it as soon as I have time.
Re:Top Books on Amazon Based on Links in Hacker News Comments by chris_wot on Monday January 18, 2016 @06:46PM (#10927868)
If it's not too much bother, any chance you'd be willing to put this on a git repository, like GitHub or Gitlab? It would be cool to be able to contribute to: for instance, being able to filter the list to fiction and non-fiction would be pretty great :-)
Re:Top Books on Amazon Based on Links in Hacker News Comments by _lpa_ on Tuesday January 19, 2016 @04:11AM (#10929483)
I might be a bit embarrassed with the code quality - this was one of my first attempts at front end development. I was planning to expand the features of the site a bit, including genre filters, so perhaps I could clean it up a bit and release it when I've done that.
Re:Top Books on Amazon Based on Links in Hacker News Comments by chris_wot on Tuesday January 19, 2016 @04:58AM (#10929659)
Oh, I wouldn't worry about that :-) if you are concerned, just say it's rough and ready in the readme. I doubt anyone will be critical, and if they are then tell them to piss off!

The beauty of open code is others can help improve it

Re:Top Books on Amazon Based on Links in Hacker News Comments by erispoe on Monday January 18, 2016 @01:15PM (#10925862)
Interesting that your list yields mainly fiction, while OP's list is mainly non-fiction.
Re:Top Books on Amazon Based on Links in Hacker News Comments by fratlas on Monday January 18, 2016 @09:00PM (#10928436)
One thing that struct me about your site (apart from being a good list, well done!) is how blazingly fast (close to HN, which I find funny) the page loads. Could you fill us mere mortals in on how the fuck you got it so fast?
Re:Top Books on Amazon Based on Links in Hacker News Comments by res0nat0r on Monday January 18, 2016 @09:16PM (#10928486)
Looks like fastly:

    $ host www.hnreads.com
    www.hnreads.com is an alias for global-nossl.fastly.net.
    global-nossl.fastly.net has address 23.235.44.204
Re:Top Books on Amazon Based on Links in Hacker News Comments by jonahx on Monday January 18, 2016 @09:19PM (#10928496)
It looks like it loads all the data on the initial page load. After that, it's a SPA app and all the links are just drawing local data.
Re:Top Books on Amazon Based on Links in Hacker News Comments by cwh on Monday January 18, 2016 @09:16PM (#10928489)
it's a simple js view for a 1.4mb json file, so "you got it so fast" really just depends on how quickly you will download that 1.4mb file.
Re:Top Books on Amazon Based on Links in Hacker News Comments by fratlas on Monday January 18, 2016 @09:40PM (#10928564)
I mean the initial http response, not even the speed of the subsequent ajax.
Re:Top Books on Amazon Based on Links in Hacker News Comments by _lpa_ on Tuesday January 19, 2016 @04:07AM (#10929475)
That's not really much to do with me - the credit there lies with fastly! This was the first time I've used a CDN, and I had a great experience using them. Highly recommended.
Re:Top Books on Amazon Based on Links in Hacker News Comments by rahimnathwani on Monday January 18, 2016 @08:05PM (#10928211)
This is really cool. I started reading HPMoR after finding it.

I'm curious: after performing NET on the corpus, how did you filter to find books only? Did you just search on Amazon's catalogue for exact matches, or was more tweaking required?

Re:Top Books on Amazon Based on Links in Hacker News Comments by _lpa_ on Tuesday January 19, 2016 @04:27AM (#10929545)
I built a little tool to help with that, but pretty much the first result on amazon was always right - for books with more than one match, at least.
Re:Top Books on Amazon Based on Links in Hacker News Comments by rahimnathwani on Tuesday January 19, 2016 @07:15AM (#10930190)
Thanks. How did you deal with, e.g. 'Steve Jobs'? I guess a generic NER tool would extract that as a single entity. Then you'd search Amazon and find an exact title match (the biography by Isaacson). But you probably don't want this in your list, as the references were to Steve Jobs the person, not Steve Jobs the book.

So did you use some manual review step to remove these?

Re:Top Books on Amazon Based on Links in Hacker News Comments by _lpa_ on Tuesday January 19, 2016 @07:38AM (#10930284)
Well, the nature of NER is that it can extract 'Steve Jobs' as either a PERSON or a BOOK entity (in my case). You can in principal extract whatever kind of entity you want, provided you have appropriate training data. The idea (loosely) is that it learns the structure of text around, say, a book. You can then label a piece of text as a book, despite not previously knowing that title. It doesn't solve the problem of two books having identical titles, however :).

(Note: I'm not an expert in NER/NLP, so please correct me if I have got something wrong!)

Re:Top Books on Amazon Based on Links in Hacker News Comments by rahimnathwani on Tuesday January 19, 2016 @10:39PM (#10935916)
Aha, I see. Thanks. I thought you were using some generic pre-trained NER, but I understand now that you used either one which was pre-trained to find books, or you trained your own.
Re:Top Books on Amazon Based on Links in Hacker News Comments by jccalhoun on Monday January 18, 2016 @01:00PM (#10925761)
As a non-programmer I find your list more interesting.
Re:Top Books on Amazon Based on Links in Hacker News Comments by wtracy on Monday January 18, 2016 @07:39PM (#10928117)
On the system browser on my phone (a Kyocera Rise running Android 4.0.4) all I see on that page is the header and footer, no content. :-( I get the same result if I hit it with Firefox with Javascript disabled, but Javascript is very much enabled on my phone browser.
Re:Top Books on Amazon Based on Links in Hacker News Comments by mdm_ on Monday January 18, 2016 @07:45PM (#10928129)
BlackBerry Passport with Javascript enabled here, I get the same thing.
Re:Top Books on Amazon Based on Links in Hacker News Comments by _lpa_ on Tuesday January 19, 2016 @04:09AM (#10929478)
Damn, sorry about that. Do you see a loading spinner on the page at all? I don't have an Android or BlackBerry, so wasn't able to test with either.
Re:Top Books on Amazon Based on Links in Hacker News Comments by wtracy on Sunday January 24, 2016 @11:34PM (#10965583)
Nope, nothing.
Re:Top Books on Amazon Based on Links in Hacker News Comments by gkst on Monday January 18, 2016 @12:27PM (#10925577)
Cool project! Do you mind telling which library or service you used for the named entity recognition?
Re:Top Books on Amazon Based on Links in Hacker News Comments by _lpa_ on Monday January 18, 2016 @12:51PM (#10925722)
I actually wrote it myself, based on conditional random fields! I would not recommend doing this - it was mostly an exercise to learn how they work. I should probably have mentioned that I manually cleaned up the results a bit. I understand nltk has NER capabilities and python bindings, though.
Re:Top Books on Amazon Based on Links in Hacker News Comments by gkst on Monday January 18, 2016 @01:51PM (#10926070)
Thanks for your reply! Going to look into the NER capabilities of NLTK.
Re:Top Books on Amazon Based on Links in Hacker News Comments by Pietertje on Monday January 18, 2016 @04:02PM (#10926909)
Thanks for sharing! This list is a list I actually expected the OP's list to be. Probably because I'm also more likely to view the Ask HN threads about books.
Re:Top Books on Amazon Based on Links in Hacker News Comments by ALee on Tuesday January 19, 2016 @02:40PM (#10933351)
It would be great if you or OP could do the analysis again on HN Reads, but with the larger dataset.
Re:Top Books on Amazon Based on Links in Hacker News Comments by edpichler on Monday January 18, 2016 @07:31PM (#10928090)
Good result. Like a curated list, but automated. I saved here for my reading list.