Re:A Prometheus fork for cloud scale anomaly detection acros...
by manigandham on Saturday March 28, 2020 @09:17PM
(#22715578)
The compression part is definitely great work. It would be a valuable addition to the main prometheus repo if they accept it.
The ability to export from prometheus to a full-featured SQL database is definitely one aspect. In addition, for scaling, efficient transport from the scraper to the data store becomes pretty important.
Beyond just compression, having a transport protocol that takes advantage of the fact that much of the data does not change across successive scrapes, and the data that does change is often incremental (e.g. counters) makes a big difference.