News for hackers. Stuff that matters.

A comment on Coinbase employees petition to remove execs. Parent comment

Re:Coinbase employees petition to remove execs by schmeckleberg on Friday June 10, 2022 @09:33AM (#31693941)
i think you and the above poster are in vehement agreement. ingesting 2 MBs of logs per minute is impressive in its pluperfect unimpressiveness.

maybe the presentation was called "Timmy's first named pipe" or "Sally explores /etc/logrotate.d"

[ Parent | on HN ]
Re:Coinbase employees petition to remove execs by FredPret on Friday June 10, 2022 @10:27AM (#31694688)
That’s a LOT of text to describe me sitting on my couch. 2MB per minute is far more than the most detailed biography in existence.
[ Parent | on HN ]
Re:Coinbase employees petition to remove execs by exdsq on Saturday June 11, 2022 @01:48PM (#31706420)
220m users. Let’s imagine 50m are streaming concurrently. That’s 100TB an hour in logs lol. They could be storing an entire petabyte of logs a day. My friend did some data center stuff for the large hadron collider and wasn’t hitting these data ingestion states, and these are just to record me binging the office.
[ Parent | on HN ]
Re:Coinbase employees petition to remove execs by ummonk on Saturday June 11, 2022 @03:28PM (#31707453)
The comment said "log processing system". Sounds more like it's a stream and not stored logs.
[ Parent | on HN ]
Re:Coinbase employees petition to remove execs by eightysixfour on Friday June 10, 2022 @10:36AM (#31694813)
2 MB/per minute/per stream at Netflix scale is crazy.
[ Parent | on HN ]