News for hackers. Stuff that matters.
Re:Living Without Atomic Clocks by jasonwatkinspdx on Wednesday February 17, 2016 @06:54PM (#11122576)
First, CockroachDB's time api is based on the Hybrid Logical Clocks paper: http://www.cse.buffalo.edu/tech-reports/2014-04.pdf

This paper is one of the most interesting published in the last couple of years IMO. I remain surprised at how many people have overlooked it. I'm not sure why this blog post makes no mention of the work, in the past the Cockroach folks have been quite explicit about crediting the research documents they're drawing from.

Second, cloudera has a patent on this work: http://www.freepatentsonline.com/y2015/0156262.html

Re:Living Without Atomic Clocks by hnkimb3558 on Thursday February 18, 2016 @10:03AM (#11126187)
CockroachDB's time api is based on the Hybrid Logical Clocks paper. We credit it on our design doc (https://github.com/cockroachdb/cockroach/blob/master/docs/de...) and in the source code.

This blog post doesn't mention HLC because the explanation didn't require it. HLC boils down to a mechanism for taking the maximum physical wall time across >= 2 nodes, while still being able to provide monotonically increasing time via incrementing the logical component of the hybrid logical timestamp. In the blog post, this is referred to as "taking the maximum timestamp across requests". A segue into HLC would have served only to further complicate the explanation.

The work done by Sandeep Kulkarni, Murat Demirbas, David Alves, Todd Lipcon, Vijay Garg, and others was instrumental to our early design efforts. I am dismayed to see there's a patent pending, though both our design and open source implementation predate the patent filing.

Re:Living Without Atomic Clocks by tlipcon on Sunday February 21, 2016 @06:28PM (#11147237)
FYI on the date issue, lest anyone think we filed the patent trying to steal the work done by others, the patent application says:

"This application claims to the benefit of U.S. Provisional Patent Application No. 61/911,720, entitled “HYBRIDTIME and HYBRIDCLOCKS FOR CLOCK UNCERTAINTY REDUCTION IN A DISTRIBUTED COMPUTING ENVIRONMENT”, which was filed on Dec. 4, 2013, which is incorporated by reference herein in its entirety."

(which predates the creation of the cockroachdb repo and the hybrid logical clock paper).

Re:Living Without Atomic Clocks by tlipcon on Wednesday February 17, 2016 @09:02PM (#11123148)
Kudu uses a similar algorithm which we call HybridTime. You can read the tech report here: http://pdsl.ece.utexas.edu/david/hybrid-time-tech-report-01....

and the source here: https://github.com/apache/incubator-kudu/blob/master/src/kud...

Both are probably more readable than patent-ese :)

Re:Living Without Atomic Clocks by jasonwatkinspdx on Thursday February 18, 2016 @12:12AM (#11123852)
I know I'm diping my toe in some history here, but is there a sense of how the patent situation is going to shake out? I think this general family of algorithm is very important.
Re:Living Without Atomic Clocks by tlipcon on Sunday February 21, 2016 @06:24PM (#11147221)
Agreed -- personally I'm against offensive use of patents like this as well, and it's my understanding that Cloudera doesn't intend to use this patent offensively. If it did, I would be upset and would consider leaving the company - I know many other employees feel the same way. The reason I agree to help write patent applications as an engineer is that I've seen the distraction and damages caused by patent trolls (or even other companies) and the importance of having a defensive portfolio.

Disclaimer: Obviously I'm not speaking for the company or making any promises here :)

-Todd

Re:Living Without Atomic Clocks by monochromatic on Wednesday February 17, 2016 @10:33PM (#11123519)
That's a pending patent application, not (yet, anyway) an actual patent.
Re:Living Without Atomic Clocks by nickpsecurity on Thursday February 18, 2016 @02:26AM (#11124240)
Far as the patent, why would one want to claim knowledge of a patent if willful infringement gives so much extra damages? ;)