News for hackers. Stuff that matters.
Re:Bootstrapping an Ultra Low Latency Trading Firm, Part 3 by shin_lao on Wednesday August 03, 2011 @05:28AM (#2840407)
The author seems to imply he reimplemented hash tables.

I was under the impression there was a fairly good number of high quality implementations of hashes tables in the wild and that it was a thoroughly studied subject.

"Not invented here" syndrome?

Re:Bootstrapping an Ultra Low Latency Trading Firm, Part 3 by veyron on Wednesday August 03, 2011 @10:05AM (#2841180)
For components not in the critical path, third party implementations are acceptable.

However, it is not surprising to see every piece in the critical path to be written in-house (feed handlers, for which there are many companies selling solutions) or rebuilt with heavy modifications (kernel).

I had intended to say hash function, but it was very late by the time I posted.

Re:Bootstrapping an Ultra Low Latency Trading Firm, Part 3 by orenmazor on Wednesday August 03, 2011 @10:42AM (#2841347)
I can fully understand it.

it's the same in the technical startups that I've been involved with (i.e. hardware or science):

- build a quick mvp with off the shelf stuff

- start optimizing.

by the time you're done, most of your parts are no longer generic and have optimizations where you need them.

Re:Bootstrapping an Ultra Low Latency Trading Firm, Part 3 by shin_lao on Wednesday August 03, 2011 @11:44AM (#2841567)
Looking forward to reading your next post then. We've worked a lot on fast data access and I wonder if you outperformed us.
Re:Bootstrapping an Ultra Low Latency Trading Firm, Part 3 by veyron on Wednesday August 03, 2011 @02:55PM (#2842473)
Do you have any latency numbers you could share? :)
Re:Bootstrapping an Ultra Low Latency Trading Firm, Part 3 by shin_lao on Thursday August 04, 2011 @03:12AM (#2845008)
We don't directly do HFT, we work with banks to help them do that well.

All the numbers I could give you is what our data engine (which is what we sell) gives on our test environment, I cannot share what our customers actually get once deployed and configured on their system.

Generally, they are happy. :)

We're going to post benchmarks soon as we're going out of stealth mode.

Re:Bootstrapping an Ultra Low Latency Trading Firm, Part 3 by nandemo on Wednesday August 03, 2011 @08:24AM (#2840833)
Well, he didn't write about hash tables in this post...

Anyway, even if there are good hash table implementations, sometimes you have to provide a custom hash function. A default hash function will not necessarily give you a table without collisions.

Re:Bootstrapping an Ultra Low Latency Trading Firm, Part 3 by shin_lao on Wednesday August 03, 2011 @08:31AM (#2840849)
There's a teaser on the matter in the end.

You're right, generally the work revolves about writing the right hash function.

We'll see in the next article.