Re:Reddit appears to be restoring edited/deleted comments
by nebula8804 on Friday June 16, 2023 @02:27PM
(#36361432)
Maybe I have this wrong but looking at academic torrents, the entire pushshift archive from 2005 to 2022 is 2TB compressed. Are they really operating at a massive scale that you are describing? Pushshift is supposed to have ingested all of Reddit's comment data no?
(Of course this is assuming pushsift has gotten the majority of comments)
Re:Reddit appears to be restoring edited/deleted comments
by notacoward on Friday June 16, 2023 @03:07PM
(#36362136)
Well, let me put it this way: if they're operating at such a small scale, they have no reason to be using any eventually consistent data store, so explanations about missing shards etc. still don't work. There are still other possibilities, as I and others have outlined, but not enough to dismiss the possibility that spez is just up to his old tricks.
It's still possible that this is innocent(ish), but at low enough probability that malice really does seem like a compelling alternative explanation. After all, spez has been caught doing something very similar before. There's proof of malicious nature, not just an assumption. When a component in a system has a certain known behavior or limit, you don't just discard that knowledge due to some handy rule of thumb.