News for hackers. Stuff that matters.
Re:Logging at Twitter by closeparen on Saturday February 19, 2022 @01:52PM (#30399452)
Exports your logs to where? I would call that place centralized logging.
Re:Logging at Twitter by dilyevsky on Saturday February 19, 2022 @02:56PM (#30399980)
I’m assuming neighboring nodes. Now you’re basically designing replicated (best effort), distributed index - a mini version of google search. This is a clever design but number of companies that can diy it with sufficient quality I can probably count on one hand
Re:Logging at Twitter by jeffbee on Saturday February 19, 2022 @03:12PM (#30400083)
For the price of even a modest splunk enterprise setup you can hire half a dozen top notch backend/distributed systems engineers. That’s the opportunity cost of a setup like the one in the article.
Re:Logging at Twitter by dilyevsky on Saturday February 19, 2022 @04:03PM (#30400511)
Right if talking top notch that’s 3-4M/y alone. Admittedly I’m completely unaware what the splunk’s ballpark rate is (i heard it’s quite high) but still I doubt that very many companies are at that scale. Also in the current market convincing execs to save on something that doesn’t translate directly to cogs can be a challenging proposition =)
Re:Logging at Twitter by closeparen on Saturday February 19, 2022 @03:47PM (#30400397)
I’ve heard this before and it sounds like Splunk’s margins are just way too high. Why doesn’t someone sell a logging platform that’s cheaper than writing your own at scale?