Launch HN: Matano (YC W23) – Open-Source Security Lake Platform (SIEM) for AWS

Re:Launch HN: Matano (YC W23) – Open-Source Security Lake Pl... by slt2021 on Tuesday January 24, 2023 @05:19PM (#34511387)

Question to Matano authors - won't your solution simply enrich AWS by blowing up my cloud bill ?

Did you estimate how many times lambda will get invoked and what will be AWS bill for 1 million events ingested? I am curious to learn the price to pay for serverless SIEM

[ Parent | on HN ]

Re:Launch HN: Matano (YC W23) – Open-Source Security Lake Pl... by shaeqahmed on Tuesday January 24, 2023 @05:29PM (#34511501)

The code is written in high performance multi-threaded Rust and uses the [1] Arrow compute framework. We also batch events and target about 32MB of event data per lambda invocations. As a result it can process tens of thousands of events per second per thread, depending on the number of transformations.

That said, we are working on performance estimates and a benchmark on some real world data for Matano to help users like you better understand the cost factors. Stay tuned.

[1] https://github.com/jorgecarleitao/arrow2

[ Parent | on HN ]