News for hackers. Stuff that matters.
Re:Streaming Search on Tweets: Storm, Elasticsearch, and Redis by atonse on Tuesday February 23, 2016 @02:27PM (#11161586)
Question for people in the know: as I read more about Erlang and Elixir, I'm starting to wonder how it holds up in such an architecture. Would it have similar performance characteristics?

Would something like spark/storm/etc be simpler to implement on top of Elixir? Possibly more performant? Or make better use of CPU cores?

Re:Streaming Search on Tweets: Storm, Elasticsearch, and Redis by thibaut_barrere on Tuesday February 23, 2016 @03:49PM (#11162207)
I'm currently working at implementing all types of ETL & data extraction processes with Elixir, and so far I must say I like this (although I cannot share numbers are the moment, just yet).

My own impression (as the author of http://www.kiba-etl.org which is a Ruby ETL framework) is that Elixir is going to be a great fit for high-quality, decent throughput data processing of all kinds (streaming, batching, or other such as websocket-api-endpoint types).

The immutable data + lightweight processes + ability to go distributed + concise code (testable, composable etc) is truly appealing in my opinion.

I will share more stuff online (at http://thibautbarrere.com) when I can, but I can only say this is so far very promising.

Re:Streaming Search on Tweets: Storm, Elasticsearch, and Redis by atonse on Thursday February 25, 2016 @05:37PM (#11178402)
Great, thanks for your reply!