Re:Launch HN: Matano (YC W23) – Open-Source Security Lake Pl...
by slt2021 on Tuesday January 24, 2023 @12:52PM
(#34507236)
the reason for that is near real-time detection of threats requires aggregation of terabytes of data according to rules (continuous GROUP BY on thousands columns on a sliding window) - and these aggregates by design have to be stored in RAM.
Otherwise these detections stop being near-realtime and become offline detection instead, just like any other sql server.
SIEM costs were rapidly ballooning, and we were being charged by RAM. RAM?? Of all things!!
After our SIEM costs for ELK ramped up to where Splunk was - we just bought Splunk instead. I imagine there are many security teams out there that would entertain a cheaper alternative that isn't priced by RAM.