Re:Google: Taming The Long Latency Tail - When More Machines...
by littledanehren on Monday March 12, 2012 @01:17PM
(#3694400)
Note: This is my own opinion, and not that of my employer (Google) or based on trade secrets or other IP from my employer.
Keeping pre-erased blocks is useful, but it can only reduce the write latency to what the chip gives you. And the chip gives you a longer write latency than read latency, especially for MLC with smaller process sizes.
Re:Google: Taming The Long Latency Tail - When More Machines...
by ori_b on Monday March 12, 2012 @01:34PM
(#3694478)
True, there is a difference between read and write latency, but at least that is consistent and therefore easy to plan for. Large variance makes things far more difficult, in my opinion.
Re:Google: Taming The Long Latency Tail - When More Machines...
by mvgoogler on Monday March 12, 2012 @08:21PM
(#3696373)
It's actually not consistent. On MLC flash, individual write operations can vary by a factor of 6.
see: http://cmrr-star.ucsd.edu/starpapers/309-Grupp-1.pdf (PDF)
Re:Google: Taming The Long Latency Tail - When More Machines...
by mvgoogler on Monday March 12, 2012 @09:23PM
(#3696555)
Having a pool of pre-erased blocks helps absorb spikes in write activity, but it doesn't let you escape the fact that, on average, an SSD will need to perform an erase operation every 128th page write (assuming 128 pages per block).
If the device is kept at or near full utilization, eventually a fast operation (read) will get delayed behind a slower operation and your tail latencies will suffer.
If there are no free blocks, or for whatever reason, the flash device elects to use a block you've already written to, you need to erase the entire block, even if you're only writing one bit. This is relatively slow.
Most high end flash devices, as I understand it, try to keep a pool of pre-erased blocks so that they can stay on the fast path, on average.
As far as I can tell, what they're saying in this article is that sometimes you can hit the slow path, and that causes high latency. On average, it's not a big deal, but for some random small number of writes, it can be an issue.