News for hackers. Stuff that matters.
Re:Someone got the natural gas report 400 ms early by JumpCrisscross on Thursday January 31, 2013 @05:12PM (#5147814)
The data are printed with the CME's and NYSE's official timestamps. It would not be unprecedented for the CME's timestamps to diverge from, say, the NYSE's. That would present itself as a consistent temporal dislocation between the CME and NYSE, but would be invisible within each data-set (sort of like your calendar putting itself into the wrong time-zone where - the times are off, but they're consistently off, i.e. spacing between events is preserved).

Instead, we see a signal within each dataset and symmetry between them. It could still be a data aberration, but that would implicate the CME and NYSE of having irregular clocks, a far more serious problem than some twat front-running a government report.

Most likely is that this is a real trading signal, but not one based on insider information.

Re:Someone got the natural gas report 400 ms early by lrm242 on Thursday January 31, 2013 @05:29PM (#5147901)
Relative timestamps between venues don't matter. More importantly, using timestamps without a common reference point makes it impossible to assert what happened first, because the absolute value of the timestamp does not matter. What matters is what "really" happened first. Of course, everyone's view of "first" can differ, but that's a different issue.

Whether there is signal here or not wasn't my point. There may well could be. My point was simply that the analysis provided by Nanex is spurious without a definition of the timestamps, where they came from, and their relationship to known reference points. Taking three events with a timestamp from each of: CQS, CME, and an arbitrary point in time such as 10:30:00 and then asserting that events observed within a CQS or CME event stream happened "before" the arbitrary point in time, 10:30:00, is impossible.

Unless either (a) one observes CQS, CME, and the event scheduled for 10:30:00 from a known reference and accounts for all variables (differing transit latencies, etc) or (b) each of the generating events are known synchronized and the current state of that synchronization is observable (CQS lags CME by 475us, government event source leads CME by 1.2ms, etc). Clearing (b) is not happening today. (a) can be accomplished by Nanex, if they so choose.

Re:Someone got the natural gas report 400 ms early by niggler on Thursday January 31, 2013 @07:45PM (#5148489)
"(a) can be accomplished by Nanex, if they so choose."

Doing so doesn't give them a sensationalist headline that finds its way to the top of HN.

Re:Someone got the natural gas report 400 ms early by tedunangst on Thursday January 31, 2013 @05:54PM (#5148012)
What I find amazing is that a government agency managed to publish a report at a specific time, to the millisecond, using somebody else's clock.
Re:Someone got the natural gas report 400 ms early by wiml on Saturday February 02, 2013 @02:42AM (#5155484)
The clock's probably derived from GPS or NIST or USNO anyway, so it actually is the government's clock.
Re:Someone got the natural gas report 400 ms early by ig1 on Thursday January 31, 2013 @06:18PM (#5148125)
I've seen exchanges screw up clock time more often than I care to remember, often for the stupidest reason. I once had an exchange claim it was "due to a roofing contractor accidentally interfering with the satellite used to get a GPS time signal".
Re:Someone got the natural gas report 400 ms early by duaneb on Thursday January 31, 2013 @07:21PM (#5148402)
I would think that exchanges would be one of the few places on earth to nail clock time because they are so dependent on it.
Re:Someone got the natural gas report 400 ms early by ig1 on Thursday January 31, 2013 @07:46PM (#5148493)
Network syncing time is hard, my team (at a bank) built our own infrastructure to monitor time sync errors on our own internal servers, we synced externally with two independent clocks. An atomic clock in London and NIST in the US. But we also modelled the exchange's time as well.

We had six independent connections to the exchange (hitting different servers) and we'd reverse engineered the exchanges internal infrastructure so based upon the timing of their messages, the tcp packet headers and their own timestamps we knew exactly what clocks their internal servers were running on (more valuably in our case is it also gave us their internal latency figures). Half the time we knew when their clocks were drifting before they did and could tell them which internal server had the wrong time.

This stuff is hard, you need to know a lot about network latency and time to make sure you're doing it right (have a look at the NTP spec for starters), there's probably only a handful of people in the world who are capable of nailing it and probably most of them work in the military or atomic physics research labs.

Re:Someone got the natural gas report 400 ms early by duaneb on Thursday January 31, 2013 @08:27PM (#5148620)
> This stuff is hard, you need to know a lot about network latency and time to make sure you're doing it right (have a look at the NTP spec for starters), there's probably only a handful of people in the world who are capable of nailing it and probably most of them work in the military or atomic physics research labs.

Funnily enough, Google appeared to have made it work well enough for a distributed database: http://research.google.com/archive/spanner.html

Re:Someone got the natural gas report 400 ms early by sseveran on Friday February 01, 2013 @12:09AM (#5149313)
Google doesn't necessarily need nano second or sub nano second resolution.
Re:Someone got the natural gas report 400 ms early by duaneb on Friday February 01, 2013 @01:21AM (#5149534)
True.