News for hackers. Stuff that matters.
Re:Show HN: We built what a $12M ICO promised by peak-of-irony on Thursday May 03, 2018 @06:55PM (#16990773)
This is neat. Are you doing your own crawling / indexing or is this data pulled in from somewhere else?
Re:Show HN: We built what a $12M ICO promised by voltaire on Thursday May 03, 2018 @07:00PM (#16990798)
Custom python crawler staging data in S3, extractors pick it up from there enriching it using DeepMoji & Fasttext pretrained models for sentiment along with some custom trained SVMs to measure influence, data gets staged in Mongo, then sent to Elastic.
Re:Show HN: We built what a $12M ICO promised by peak-of-irony on Thursday May 03, 2018 @07:03PM (#16990811)
Any particular reason you didn't opt for scrapy...