News for hackers. Stuff that matters.
Re:Western Digital unveiled its SanDisk 1TB SDXC card prototype by jrockway on Tuesday September 20, 2016 @10:55AM (#12539975)
Flash is actually super lossy (especially non-SLC technology), it only appears to durably store your data because of error correction and redundancy.

This is something I never realized until I worked on an embedded system where every bit error showed up as a log message. It made me think, "how can computers work at all"? The answer is math and abstraction layers that work a little bit better than the average web framework.

Re:Western Digital unveiled its SanDisk 1TB SDXC card prototype by TickleSteve on Wednesday September 21, 2016 @01:56AM (#12545754)
wear-levelling and bad-block management are not magic.

The failure modes of FLASH are well-known, they dont necessarily need abstraction layers and they do work very well and reliably.

Re:Western Digital unveiled its SanDisk 1TB SDXC card prototype by lallysingh on Wednesday September 21, 2016 @09:16AM (#12547829)
I think when someone on HN refers to a specific piece of tech as magic, they're not saying that it's literally magical.
Re:Western Digital unveiled its SanDisk 1TB SDXC card prototype by StillBored on Thursday September 22, 2016 @06:18PM (#12560811)
Right, and usually SD cards don't have anywhere the level of FTL's that SSD's have. In fact its likely there isn't much of a FTL at all, rather just a simple ECC on the flash pages. Lose more bits in that page than the ECC can correct, and the whole card is basically done because it can't relocate sectors. SD isn't meant to be primary storage. Its meant to be used more like floppies/usb sticks.

I can't tell you how many android phones I "fixed" for a couple years by replacing the SD cards. I actually had a sandisk 128G fail on me a couple weeks ago, that was just sitting in a dell/windows tablet with little more than a few movies copied to it. It didn't last 6 months, I guess something in win10 must have been rewritting a date/time stamp or something similar to the same sector long enough that the card just started hanging doing reads until it became bad enough that windows would choke and I noticed it.

Back about 10 years ago, I had an ARM device with an SD slot that I was writing firewall logs to. The SD cards in that machine would last ~2 months before they died. Eventually I replaced the SD cards with a USB attached SSD in an enclosure, and that fixed the problem.

Re:Western Digital unveiled its SanDisk 1TB SDXC card prototype by jrockway on Thursday September 22, 2016 @01:06PM (#12558313)
I used the word math, not magic.

There are many abstraction layers involved. For example, your Linux application isn't bit-banging the NAND chips directly. Your SoC knows there's flash attached, and handles it accordingly. Or, the Linux MTD layer handles it. Then, there are the flash-specific filesystems, like ubifs.

All in all I find it pretty interesting, because if you "echo foo > /dev/mtdX", you're not going to find any sequence of flash cells that contain the bit pattern 0x66 0x6f 0x6f 0x0a for very long after you do that write. And yet everything works anyway. There is a _high probability_ that you will be able to read it back, but there it's never guaranteed.

Nothing is ever guaranteed. All we can do is increase the probability of success.

Re:Western Digital unveiled its SanDisk 1TB SDXC card prototype by kabdib on Wednesday September 21, 2016 @09:24AM (#12547894)
Flash storage management is still hard to get right, especially when the power can be removed at any time. Making data structures resilient to arbitrary power removal while having good performance is quite a feat.
Re:Western Digital unveiled its SanDisk 1TB SDXC card prototype by smhg on Wednesday September 21, 2016 @04:48AM (#12546477)
> that work a little bit better than the average web framework

you have a reference for this? which aspects did you compare or were compared?

Re:Western Digital unveiled its SanDisk 1TB SDXC card prototype by bendbro on Wednesday September 21, 2016 @05:03AM (#12546546)
I think that was intended to be a joke, as when I think of the average web framework, I see buggy junk.