Re:Show HN: A cryptocurrency news scraper inspired by Hacker...
by notnull on Tuesday January 23, 2018 @05:00PM
(#16218182)
Can you say more about how you built this? How you did the scraping, etc. ?
[ Parent
| on HN ]
Re:Show HN: A cryptocurrency news scraper inspired by Hacker...
by howiem on Tuesday January 23, 2018 @05:26PM
(#16218415)
For scraping I've used the webhose api (I am still on the free account hence when u click on the link it has a 5 second redirect). I've found it is an excellent resource and easy to use API, I highly recommend it http://webhose.io/
For the tech stack its just node.js and express on the backend and vanilla JS on the front end using webpack for bundling. I built this project really as a means to teach myself to write unit tests better and mock integration tests. In the first iterations I fed the news articles after they were scraped into Google's Natural Language Processing library to get the sentiment of the article. I scrapped this after it became too inaccurate.