News for hackers. Stuff that matters.
Re:First release candidate for TimescaleDB 1.0 by qaq on Wednesday September 19, 2018 @03:37PM (#18027070)
Nice product for small/mid scale workloads. It's no Vertica or ClickHouse but if you do not need the scale should work well.
Re:First release candidate for TimescaleDB 1.0 by cevian on Wednesday September 19, 2018 @04:25PM (#18027429)
To put a number on this claim. TimescaleDB at this point can handle up to 100 TB of data.
Re:First release candidate for TimescaleDB 1.0 by wenc on Wednesday September 19, 2018 @05:34PM (#18027894)
For pure time-series, that is huge.

The bulk of time-series data is floating point numbers, which are fairly tiny in terms of storage.

100 TB is a lot of time series.

Re:First release candidate for TimescaleDB 1.0 by comboy on Wednesday September 19, 2018 @04:54PM (#18027628)
Where does the limitation come from? Or is it just the amount of data that it's been tested on?
Re:First release candidate for TimescaleDB 1.0 by mfreed on Wednesday September 19, 2018 @05:53PM (#18027989)
TimescaleDB clustering is currently limited to a single primary with multiple read-only replicas (which provide both HA failover and scaling concurrent reads).

So the limitation here is the storage capacity available for the nodes, and so the above reflects the amount of data we've seen in use in various RAIDed or network-attached storage environments (like the cloud).

One interesting thing here is that you can "elastically" add a new disk to a existing hypertable, and new writes will be automatically load balanced across the new disk. (In Postgres speak, we support multiple tablespaces in a single hypertable, and we allow you to dynamically add a new tablespace to an existing one: https://docs.timescale.com/api#attach_tablespace )

Re:First release candidate for TimescaleDB 1.0 by cevian on Wednesday September 19, 2018 @05:52PM (#18027979)
The latter. Because of the table partitioning there is not much dependency between old and new data so we've seen consistent performance as you add more and more data.
Re:First release candidate for TimescaleDB 1.0 by qaq on Wednesday September 19, 2018 @08:26PM (#18028751)
It's not only about size but about speed column stores that store compressed data and process data in blocks using SIMD perform significantly faster on many query types.
Re:First release candidate for TimescaleDB 1.0 by cevian on Wednesday September 19, 2018 @08:57PM (#18028893)
While it's true column stores perform better on single-column aggregates, they perform worse on multi-column operations, thresholding queries, and other types of complex analytics that one often sees on time-series workloads. We have published benchmarks on some common column stores that show these tradeoffs.
Re:First release candidate for TimescaleDB 1.0 by wenc on Thursday September 20, 2018 @09:37AM (#18032311)
This is slightly outside the scope of what TimescaleDB handles, but conceptually is it possible to create both row and column indices, and have the query engine hit one or the other depending on the query?

SQL Server sort of does this with traditional indices and columnstore indices. Indices are derived data structures that represent a view of the original dataset, so in theory it shouldn't matter if the original data is stored in rows or columns.

Re:First release candidate for TimescaleDB 1.0 by qaq on Wednesday September 19, 2018 @10:58PM (#18029426)
Would be interesting to see benchmarks vs performant options e.g Vertica and ClickHouse
Re:First release candidate for TimescaleDB 1.0 by lykr0n on Wednesday September 19, 2018 @04:09PM (#18027303)
If TimescaleDB could get some clustering & sharding going on, that'd be awesome. Maybe team up with Citus