News for hackers. Stuff that matters.
Re:Production Twitter on One Machine: 100Gbps NICs and NVMe ... by therealdrag0 on Saturday January 07, 2023 @06:54PM (#34294408)
Also Search (the article did says these wouldn’t fit to be fair but the discussion seems to be ignoring how much wouldn’t fit and why). Search is pretty expensive especially since to have it responsive you need the indexes to fit in memory—at least the Lucene variety, which at least in old YouTube videos Twitter used.
Re:Production Twitter on One Machine: 100Gbps NICs and NVMe ... by marcusae313 on Sunday January 08, 2023 @01:37AM (#34296665)
Twitter still uses Lucene. They built a custom codec for it, but doesn't change the cost too much.