How Discord Stores Billions of Messages (2017)

Re:How Discord Stores Billions of Messages (2017) by vortico on Tuesday August 24, 2021 @08:32PM (#28296741)

I'd imagine Discord uses deduplication, but I bet it doesn't save them 5% storage space.

[ Parent | on HN ]

Re:How Discord Stores Billions of Messages (2017) by Ekaros on Wednesday August 25, 2021 @07:28AM (#28300220)

I think it might, spamming same meme images over and over is quite common in some servers. On other hand the bigger pictures might overhelm these just in size.

[ Parent | on HN ]

Re:How Discord Stores Billions of Messages (2017) by vortico on Wednesday August 25, 2021 @05:38PM (#28307412)

Yeah, that's why I assumed it wouldn't help that much. People re-upload 100kB memes all the time, but the bulk would probably be 5MB phone pictures that won't typically be re-uploaded.

[ Parent | on HN ]

Re:How Discord Stores Billions of Messages (2017) by kroltan on Tuesday August 24, 2021 @10:25PM (#28297414)

The plural of anecdote isn't data, but about 20% of the images I post on Discord come from Discord in the first place, cross-posting among different servers.

[ Parent | on HN ]