News for hackers. Stuff that matters.
Re:Simple Systems Have Less Downtime (2020) by bryanrasmussen on Wednesday August 04, 2021 @11:57AM (#28062562)
>Guess what? 99% of people on here don't have billions of rows of event data they need to regularly aggregate. Problem solved.

having built a real time analytics solution a few years ago because we wanted one we controlled for our startup, it doesn't take much to get to billions of rows of event data in the modern web.

Re:Simple Systems Have Less Downtime (2020) by Spivak on Wednesday August 04, 2021 @01:08PM (#28063522)
At last $dayjob we were a speck compared to even the smallest "webscale" consumer B2C app and we gathered 800mil tracing events a week.
Re:Simple Systems Have Less Downtime (2020) by eatonphil on Wednesday August 04, 2021 @12:27PM (#28062948)
Yup. How many variations of analytics startups/companies exist out there? How many customers do they each have with how many events happening per customer?

Analytics on large-ish data is definitely a common challenge. And sure, CRUD is even more common. But knowing what your options are for each challenge makes sense.

Re:Simple Systems Have Less Downtime (2020) by bryanrasmussen on Thursday August 05, 2021 @03:34AM (#28070906)
this relates https://news.ycombinator.com/item?id=28047618 if the giants are generating exabytes per year it seems reasonable to expect that your smaller application can end up with a few terabytes in the same time.