EventReduce: An algorithm to optimize database queries that run multiple times

Re:EventReduce: An algorithm to optimize database queries th... by truth_seeker on Thursday April 16, 2020 @11:27AM (#22890379)

>> There is a big difference between a change-stream and a realtime query. For example mongodbs cursor-stream is a good way to observe the events that happen to a specific collection or documents that match some criteria. If you want the realtime-results of a query that has sorting, skip limit etc. than it is really hard to warp the changestream into this.

Have you actually tried it from mongo shell or any mongodb client driver ?

In the official document link which i shared it is clearly mentioned it supports aggregation pipeline. Any operator which is compatible with aggregation pipeline framework including "$sort" and "$skip" can be used. You can also use JOIN like operator "$lookup" or "$graphLookup".

See this link for info https://docs.mongodb.com/manual/core/aggregation-pipeline-op...

[ Parent | on HN ]

Re:EventReduce: An algorithm to optimize database queries th... by eventreduce on Thursday April 16, 2020 @11:32AM (#22890433)

Yes I used it. I actually know it really well. I also did performance comparisons with mongodb and mongodbs change stream and cursors. What I posted here is just an algorithm. You could now compare it to mongodb (a product) and say it is a "more flexible solution" but I do not see the point in directly comparing it simply based on the documentation of both.

[ Parent | on HN ]

Re:EventReduce: An algorithm to optimize database queries th... by truth_seeker on Thursday April 16, 2020 @12:51PM (#22891255)

>> Yes I used it. I actually know it really well. I also did performance comparisons with mongodb and mongodbs change stream and cursors.

Can you share the link for the code and data in Database against which you are querying to prove your claim ?

[ Parent | on HN ]

Re:EventReduce: An algorithm to optimize database queries th... by eventreduce on Thursday April 16, 2020 @01:48PM (#22891787)

No and I also do not want to "claim" something. Feel free to do your own tests.

[ Parent | on HN ]