Re:Show HN: We built what a $12M ICO promised
by peak-of-irony on Thursday May 03, 2018 @06:55PM
(#16990773)
This is neat. Are you doing your own crawling / indexing or is this data pulled in from somewhere else?
[ Parent
| on HN ]
Re:Show HN: We built what a $12M ICO promised
by voltaire on Thursday May 03, 2018 @07:00PM
(#16990798)
Custom python crawler staging data in S3, extractors pick it up from there enriching it using DeepMoji & Fasttext pretrained models for sentiment along with some custom trained SVMs to measure influence, data gets staged in Mongo, then sent to Elastic.
Re:Show HN: We built what a $12M ICO promised
by peak-of-irony on Thursday May 03, 2018 @07:03PM
(#16990811)
Any particular reason you didn't opt for scrapy...