We have developed kind of the same concept but agnostic to the underlying runtime. by agnostic, I mean that we can take advantage of Hadoop (via cascading) for our full indexation processes or Storm for the incremental indexation processes. Another difference is the way we handle the data, we chose to use tuples (as in cascading and storm) to transfer the data between the different components.