News for hackers. Stuff that matters.
Re:Update on the Twitter Archive at the Library of Congress by strictnein on Friday January 05, 2018 @11:49AM (#16079694)
It's sometimes mentioned in their blog posts:

https://blog.twitter.com/engineering/en_us/topics/infrastruc...

Not a lot of specifics, but there's some interesting tidbits:

> Hadoop: We have multiple clusters storing over 500 PB divided in four groups (real time, processing, data warehouse and cold storage). Our biggest cluster is over 10k nodes. We run 150k applications and launch 130M containers per day.

There are no comments on this comment yet.