Re:I Want a New Data Store (for Craigslist)
by jzawodn on Wednesday April 28, 2010 @11:54PM
(#1303535)
This was... lemme see. less /proc/cpuinfo
Intel(R) Xeon(R) CPU X5570 @ 2.93GHz
So it was a pretty high-end Nehalem proc already. And, yeah, we do have ECC RAM in the box, of course. Plus InnoDB does page-level checksumming to guard against corruption too.
But still, it was ~8 hours or so. Using all 8 cores on the box would have brought it down to ~1 hour if it could have been perfectly parallelized (and much of it could have been, I bet).
Ah okay, so even with the fastest clocks available today, the best you could hope for is cutting the 8 hours to 4, or one month to two weeks.
As far as the parallel cores it sounds like you already have thought about possible "end runs" around MySQL's "transaction safe" ALTER (which is probably why it's single threaded). InnoDB supposedly has a few performance improvements for ALTER over MyISAM so you are already taking advantage of that.
Re:I Want a New Data Store (for Craigslist)
by soundsop on Thursday April 29, 2010 @02:04AM
(#1303712)
Memory ECC won't help if computations are incorrect.
Good computations won't help if your memory is corrupt.
Re:I Want a New Data Store (for Craigslist)
by reitzensteinm on Thursday April 29, 2010 @05:47AM
(#1303976)
That's not what soundsop was saying - he was just pointing out the obivous error in the suggestion to overclock the CPU, and then use ECC to be safe. The ECC, though a good idea by itself, will not help with any errors introduced by the overclock.
If single core is the problem, throw a massive clock rate at it?
The i5-680 is out this month and is 3.6ghz native ("turbo" near 4ghz) should do 5ghz with good air cooling (it's 32nm) and then you could use ECC memory to be certain in a mission-critical environment?