News for hackers. Stuff that matters.
Re:Show HN: A cryptocurrency news scraper inspired by Hacker... by notnull on Tuesday January 23, 2018 @05:00PM (#16218182)
Can you say more about how you built this? How you did the scraping, etc. ?
Re:Show HN: A cryptocurrency news scraper inspired by Hacker... by howiem on Tuesday January 23, 2018 @05:26PM (#16218415)
For scraping I've used the webhose api (I am still on the free account hence when u click on the link it has a 5 second redirect). I've found it is an excellent resource and easy to use API, I highly recommend it http://webhose.io/

For the tech stack its just node.js and express on the backend and vanilla JS on the front end using webpack for bundling. I built this project really as a means to teach myself to write unit tests better and mock integration tests. In the first iterations I fed the news articles after they were scraped into Google's Natural Language Processing library to get the sentiment of the article. I scrapped this after it became too inaccurate.