News for hackers. Stuff that matters.
Re:ArcticDB: Why a Hedge Fund Built Its Own Database by porker on Sunday August 25, 2024 @04:38AM (#41345611)
> Versioned modifications ("time travel") - ArcticDB is bitemporal. > Timeseries indexes.

That's a nice addition.

Re:ArcticDB: Why a Hedge Fund Built Its Own Database by blitzar on Sunday August 25, 2024 @04:59AM (#41345717)
Given how high a selling point this is, it is something that I cannot recall ever using in ArcticDB (5+ years of using). It's (financial) time series data, the past doesn't change.

Back adjusting futures contracts or back adjusting for dividends / splits come to mind as I write this, but I would just reprocess these tasks from the raw data "as of date" if needed.

Re:ArcticDB: Why a Hedge Fund Built Its Own Database by jjmunro on Sunday August 25, 2024 @05:39AM (#41345936)
100% makes sense, it depends what you're looking for.

There are however lots of time-series that do change in Finance, e.g. valuations, estimates, alt-data (an obvious one is weather predictions). The time-travel feature can being super useful outside of external data changing as well, as an audit-log, and as a way to see how your all-time evaluations have changed (say backtests).

Re:ArcticDB: Why a Hedge Fund Built Its Own Database by nzjrs on Sunday August 25, 2024 @07:50AM (#41346612)
Id be interested to hear how often you have your team use this to also store historical backtest results as people iterate on strategies.
Re:ArcticDB: Why a Hedge Fund Built Its Own Database by dnadler on Sunday August 25, 2024 @08:46AM (#41346921)
I’ve never seen it used for backtests personally. Generally backtested results are saved as a batch of variants following some naming convention as different symbols.
Re:ArcticDB: Why a Hedge Fund Built Its Own Database by jjmunro on Monday August 26, 2024 @05:12AM (#41355318)
So, yes, separating the use-cases out...

You would use some convention for naming and parametrising backtests, 'different' backtests would get stored separately. But once you start updating backtests, running them in a loop with changing data, that's when the time-travel feature starts to be useful.

Re:ArcticDB: Why a Hedge Fund Built Its Own Database by dnadler on Monday August 26, 2024 @12:26PM (#41358839)
Yeah, that’s fair, and something you basically get for free.

Also, hi James! :)

Re:ArcticDB: Why a Hedge Fund Built Its Own Database by jjmunro on Monday August 26, 2024 @05:08AM (#41355284)
It's a primary use-case.
Re:ArcticDB: Why a Hedge Fund Built Its Own Database by dnadler on Sunday August 25, 2024 @08:41AM (#41346899)
For pricing data, sure, but for things like fundamentals or economics where there are estimates that are revised over time, one way to store this data is with a versioning feature. It allows for PIT data without much overhead, in theory.

And actually, pricing can be revised as well, though it is much less common.

That said, versioning is not the only way to handle these kinds of things.

Versioning can also be useful as an audit trail for data transformation. Though again, these could be stored in another way as well.