News for hackers. Stuff that matters.
Re:Save $2.5M per Year by Managing Logs the AWS Way by laurahohmann on Thursday November 16, 2023 @01:41PM (#38293549)
The calculator was particularly interesting - how does it handle doing archiving? If you're cutting the data down, are you losing historical record?
Re:Save $2.5M per Year by Managing Logs the AWS Way by TheIronYuppie on Thursday November 16, 2023 @01:43PM (#38293570)
Yeah part of what we’re doing in this example is after you access the summary data, then move the raw data to an archive like Glacier. Savings still works!

Disclosure: I cofounded Bacalhau

Re:Save $2.5M per Year by Managing Logs the AWS Way by alyrik on Thursday November 16, 2023 @01:15PM (#38293245)
I'm mainly excited that you can just deploy a generic tool like Bacalhau across your cluster and have it as a platform to manage your logs and a whole bunch of other workload/management stuff, rather than needing to install a million different special-purpose things on every machine!
Re:Save $2.5M per Year by Managing Logs the AWS Way by TheIronYuppie on Thursday November 16, 2023 @01:22PM (#38293338)
Yep exactly! We got a lot of inspiration from Kubernetes and Nomad - we think their declarative job format and the use of arbitrary package binaries (WASM/Docker) was how they caught fire and changed an ecosystem.

Disclosure: I co-founded Bacalhau

Re:Save $2.5M per Year by Managing Logs the AWS Way by TheIronYuppie on Thursday November 16, 2023 @12:47PM (#38292830)
Hi all!

We're super proud to introduce a new series of use cases around Bacalhau. This week is all about log processing - where you can save 90%+ (that's not a typo) managing your logs.

Please let us know if you have any questions!

Disclosure: I co-founded Bacalhau.

Re:Save $2.5M per Year by Managing Logs the AWS Way by AlexMcCarroll on Friday November 17, 2023 @04:56AM (#38301506)
The money saved from data preprocessing Splunk v Bacalhau is interesting. I wonder how this could affect big enterprises that spend millions on the preprocessing of data.