News for hackers. Stuff that matters.
Re:Show HN: RethinkDB change feeds for indexing Algolia by firloop on Saturday October 29, 2016 @02:02PM (#12825328)
At my work we use Rethink changefeeds to accomplish literally the same task. We use changefeeds to filter and pipe data to Algolia and numerous other services. Works like a breeze and takes surprisingly little code to get up and running.
Re:Show HN: RethinkDB change feeds for indexing Algolia by dignati on Saturday October 29, 2016 @02:14PM (#12825419)
I wonder how you deal with restarting changefeeds? The last time I checked you'd have go through every document again after losing the connection to rethinkdb or restarting the server.
Re:Show HN: RethinkDB change feeds for indexing Algolia by firloop on Saturday October 29, 2016 @04:05PM (#12826043)
We use changefeeds more or less of a queue/pipeline and don't care too much about the initial state. When the changefeeds are created we specifically don't pass the includeInitial argument [0] so we only get a stream of newly modified/created documents.

[0]: https://rethinkdb.com/docs/changefeeds/javascript/#including...

Re:Show HN: RethinkDB change feeds for indexing Algolia by _asummers on Saturday October 29, 2016 @03:41PM (#12825907)
In a slightly different use case than what OP is describing, we keep track of createdAt and updatedAt in Rethink, order by those, and pick off from max(createdAt) in destination in order to fake restarting the feeds.