Re:Principles of Sharding for Relational Databases
by user5994461 on Wednesday August 09, 2017 @05:33PM
(#14973859)
The thing is that 5TB of company data cannot reasonably be kept in JBOD on the cheapest drives you could find on Amazon.
Re:Principles of Sharding for Relational Databases
by sigstoat on Wednesday August 09, 2017 @05:52PM
(#14974052)
if you're insisting on using the cheapest drives on amazon, you probably can't fit 5TB of data into a small room worth of computers.
if you're a reasonable person, you buy 6 1TB samsung SSDs and stuff them into a single 2U case and you're done.
Re:Principles of Sharding for Relational Databases
by user5994461 on Wednesday August 09, 2017 @07:13PM
(#14974642)
And you're gonna cry when the RAID0/JBOD fails and you lose all your data.
Let's not pretend there is anything reasonable in this setup.
Re:Principles of Sharding for Relational Databases
by gjjrfcbugxbhf on Thursday August 10, 2017 @02:26AM
(#14976988)
Presumably your data is (1) mirrored to another similar server ready to replace in case of failure and (2) also regularly backed up to two off-site locations...
if all you need is a lot of data in a single database, there's basically nothing except for money between you and your goal. JBODs full of SSDs coming into a single machine via SAS will get you into petabytes, just with commodity hardware you can order from amazon.
i'm expect IBM could sell you a mainframe that'll do it for whatever capacity you care to name.