News for hackers. Stuff that matters.
Re:Logging at Twitter by netik on Friday February 18, 2022 @09:40PM (#30393942)
such a sad read.

In the beginning there were so many great technologies there for dealing with logs and data at scale and they caved in and bought splunk.

An insanely expensive solution that was already long solved there for years

Re:Logging at Twitter by nikolay on Friday February 18, 2022 @11:55PM (#30394526)
It's even sadder that it's an ad.
Re:Logging at Twitter by breakingcups on Saturday February 19, 2022 @07:50AM (#30396761)
It was probably a contractual obligation to lower the cost of Splunk
Re:Logging at Twitter by nikolay on Saturday February 19, 2022 @06:58PM (#30401770)
It's an embarrassing post, which I read like "we can't even build a commodity subsystem properly". And I think it also does not sound well for Splunk either - it's like a sign of desperation!
Re:Logging at Twitter by GordonS on Saturday February 19, 2022 @10:29AM (#30397793)
I believe that, it actually reads like it was written by someone at Splunk! Very little detail about what they are logging and why - it's a surprisingly poor article that is little more than a crappy ad for Splunk.
Re:Logging at Twitter by Macha on Saturday February 19, 2022 @08:22AM (#30396966)
With their previous tech stack, they were dropping 90% of logs via a rate limiter. This means that if you were looking to investigate a specific incident, the logs are much more likely to not be there. That feels more "fatally flawed" than "great"
Re:Logging at Twitter by mdoms on Friday February 18, 2022 @09:53PM (#30393991)
I've worked at two organisations that use Splunk at huge scale. There really is no good alternative when you get really big and want a managed service.
Re:Logging at Twitter by jms703 on Friday February 18, 2022 @10:10PM (#30394074)
This.

Also, when you have bespoke log solutions and engineers leave, you end up with unsupported solutions. This may be Twitters 4th logging solution IIRC. Plenty of people know splunk. Loglens, not so much.

Re:Logging at Twitter by orlovs on Saturday February 19, 2022 @02:59PM (#30400004)
+many. There are plenty good Enterprise software with bad rep. You can spend a lot of engineering talent to rebuild what is already solved or just buy boring tech. Splunk by definition is boring and with Twitter scale makes sense. Twitter is not too big, its decently sized.
Re:Logging at Twitter by saryant on Friday February 18, 2022 @11:59PM (#30394542)
Loglens, there’s a word I hope to never hear again.