Re:Cache is the new RAM
by activus on Wednesday November 19, 2014 @04:28PM
(#8632726)
These would be great. One thing I had need for at a previous job was a combined search / compute engine.
We basically had a search cluster that would return ids that would get joined into the actual data in another system, then we'd do heavy post-processing and push it off to another system for slicing and dicing.
Not sure if it's any use to anyone else, but a system that allowed people to push search queries into a cluster, do some user defined post-processing and then have the engine pipe that to an endpoint would have been interesting for that use case.
I believe there's some Hadoop eco-system bits that do a bit of this now (Impala comes to mind).
We basically had a search cluster that would return ids that would get joined into the actual data in another system, then we'd do heavy post-processing and push it off to another system for slicing and dicing.
Not sure if it's any use to anyone else, but a system that allowed people to push search queries into a cluster, do some user defined post-processing and then have the engine pipe that to an endpoint would have been interesting for that use case.
I believe there's some Hadoop eco-system bits that do a bit of this now (Impala comes to mind).