News for hackers. Stuff that matters.
Re:Fujifilm Created a Magnetic Tape That Can Store 580 Terab... by dijit on Monday December 28, 2020 @05:24PM (#25563976)
Great, so when can I buy one and how much will the tape drive cost?

The largest issue with tape is that the drives themselves cost absurd amounts, and you better not cheap out because failure is both time consuming and scary.

Swapping tapes continues to be human intensive and restore times long. But the tapes themselves are so cheap that at this scale it becomes worthwhile again.

Re:Fujifilm Created a Magnetic Tape That Can Store 580 Terab... by vondur on Monday December 28, 2020 @05:29PM (#25564018)
This is geared for enterprise settings, not home use. I believe someone mentioned these drives costing $25,000. I do agree reasonably priced tape drives with TB of space for home users would be great.
Re:Fujifilm Created a Magnetic Tape That Can Store 580 Terab... by weare138 on Monday December 28, 2020 @05:59PM (#25564304)
The prices are much cheaper now. You can get a single tape drive for under $300 and enterprise grade single tape drives for under $3k.

https://www.newegg.com/p/2BM-000A-000M5

https://www.provantage.com/quantum-tc-l72an-br~7QUAT0JW.htm

Re:Fujifilm Created a Magnetic Tape That Can Store 580 Terab... by ardy42 on Monday December 28, 2020 @06:52PM (#25564810)
> The prices are much cheaper now. You can get a single tape drive for under $300 and enterprise grade single tape drives for under $3k.

Those tapes only hold 200 GB, and you can get a 10 TB hard drive today for less than $300:

https://www.newegg.com/red-wd101efax-10tb/p/N82E16822234407

While tapes are theoretically cool, the the drives are just too rare for them to be of any practical value to a home user. Even if the media has a better archival life than a hard disk (say 50 years), it won't do you a damn bit of good if there are no drives available in 50 years to read it.

IMHO, hard drives are better for backup (even offline backup, just get a hot-swap bay and imagine the drive is tape [1]). Archival is a harder problem, but I've settled on using high-grade optical media, burned slow for fewer errors, making a bunch of redundant copies. Even though the media might not last as long, I'm pretty much guaranteed to be able to find a drive for the next several decades [2].

[1] "pretend this hard drive is a tape" is even an enterprise product: https://en.wikipedia.org/wiki/RDX_Technology

[2] For instance, you can still attach a 5.25 floppy drive to a modern computer: https://www.ebay.com/sch/i.html?_nkw=5.25+floppy+drive + http://www.deviceside.com/fc5025.html

Re:Fujifilm Created a Magnetic Tape That Can Store 580 Terab... by klodolph on Monday December 28, 2020 @07:11PM (#25564974)
> Those tapes only hold 200 GB, and you can get a 10 TB hard drive today for less than $300:

That was a link to an obsolete LTO-2 drive. If you’re using LTO-8, which is the current generation, you’d get a 10-pack of 12TB tapes for around $500. Noticeably cheaper per byte than hard drives.

I don’t recommend LTO-2 just because I don’t think that the drives are well-supported.

> While tapes are theoretically cool, the the drives are just too rare for them to be of any practical value to a home user. Even if the media has a better archival life than a hard disk (say 50 years), it won't do you a damn bit of good if there are no drives available in 50 years to read it.

If you’re evaluating just on the basis of the price of drives / media, then there’s a cutoff where tape becomes cheaper than hard drives. The easy way to calculate this cutoff is to divide the overhead cost (tape drive price) by the difference in the cost per TB of tapes and hard drives, which in the example here, is around $3k divided by $25/TB, or 120 TB.

In other words, if you have more than about 120 TB of data, then it is cheaper to buy a tape drive. I think any comments about whether tape drives are suitable for home use are really comments about whether you are interested in the use case of people who need to store >120 TB at home.

If you are running a YouTube channel as a hobby, or you run a side business doing videography for weddings, the tape drive starts to sound a lot better. The 120 TB cutoff might be around 300 hours of video, which might be only 50 events.

There are a lot of other reasons why you might NOT want to use tape, but it’s easy to have enough data that tape is the cheapest storage option. At “enterprise” scale the cost calculus is completely different and involves things like support contracts with Oracle (not necessary for hard drives), power/cooling in your DC (tape is very low-power), etc.

And let’s not forget that if you have 120TB of hard drives, you’re in the regime where you start having to buy multiple machines.

As for longetivity—I don’t have the data handy. If you are storing data on tape, you need to migrate to newer generations of tape, as old generations become obsolete and unavailable. If you are storing on hard disks, you also need to migrate because hard disks eventually fail (even if they are not powered on).

Re:Fujifilm Created a Magnetic Tape That Can Store 580 Terab... by ardy42 on Monday December 28, 2020 @07:33PM (#25565129)
> That was a link to an obsolete LTO-2 drive. If you’re using LTO-8, which is the current generation, you’d get a 10-pack of 12TB tapes for around $500. Noticeably cheaper per byte than hard drives.

But it looks like the cheapest drive on Newegg for that is $3,299.00: https://www.newegg.com/p/2BM-0046-00001

> In other words, if you have more than about 120 TB of data, then it is cheaper to buy a tape drive. I think any comments about whether tape drives are suitable for home use are really comments about whether you are interested in the use case of people who need to store >120 TB at home.

> If you are running a YouTube channel as a hobby, or you run a side business doing videography for weddings, the tape drive starts to sound a lot better. The 120 TB cutoff might be around 300 hours of video, which might be only 50 events.

No dispute there, but I think most >120 TB home use cases run into the question of if it's even worth it to keep the data (raw/uncompressed). For most people, the answer is probably no, and curation/compression makes far more sense. For instance, I don't think it's even typical for wedding photographers/videographers to store their final product indefinitely, let alone the raw footage for a re-edit. You can keep a lot more events in a lot less space if you're only keep the raw footage for a few recent events and the 15-30 minute final edit for a year after it's finalized.

> And let’s not forget that if you have 120TB of hard drives, you’re in the regime where you start having to buy multiple machines.

Not if you swap disks as offline storage.

> As for longetivity—I don’t have the data handy. If you are storing data on tape, you need to migrate to newer generations of tape, as old generations become obsolete and unavailable. If you are storing on hard disks, you also need to migrate because hard disks eventually fail (even if they are not powered on).

Honestly, the theoretical longevity is the only aspect of tape that appeals to me, but like you said enterprise tapes will end up being like these enterprise optical disks in a fairly short period of time, so you're regularly going to have migration legwork to do or your data's effectively toast.

https://twitter.com/foone/status/1236524992709316608

Re:Fujifilm Created a Magnetic Tape That Can Store 580 Terab... by Karunamon on Monday December 28, 2020 @10:42PM (#25566489)
You don't even need the absolute latest drives to get reasonable storage volumes. Some careful shopping can net you an LTO-5 (1.5TB native capacity) library unit (one that can be upgraded to newer generations) for under $500, with new tapes $10-15 each.

The nice thing about LTO as a format is its relative predictability and ease of acquiring the parts, even the very obsolete ones. It's all SCSI or SAS, most of the interesting stuff happens at the hardware level, with a bog-standard API. Your average backup app, whether it be Backup Exec or mtx/tar/etc. on Linux doesn't need to care about the media format. Unlike actual "enterprise" shops with datacenters and support contracts and such cruft, where the primary concern is "does it work", it is fine to buy older units second-hand. They are plentiful and cheap.

Re:Fujifilm Created a Magnetic Tape That Can Store 580 Terab... by gruez on Monday December 28, 2020 @11:39PM (#25566791)
> You don't even need the absolute latest drives to get reasonable storage volumes. Some careful shopping can net you an LTO-5 (1.5TB native capacity) library unit (one that can be upgraded to newer generations) for under $500, with new tapes $10-15 each.

That's still... pretty terrible. If we compare you costs for a tape drive against a 14TB easystore @ $190[1], the break-even point is around 72TB. I don't know about you, but that's of data you have to store for it to be worth it. Even at 150TB you're only looking at around ~25% (~$500) in savings compared to hard drive, which I don't think is much when you factor in how much of a hassle tape drives are to work with.

[1] https://slickdeals.net/f/14587381-14tb-wd-easystore-external...

[2] https://www.wolframalpha.com/input/?i=solve+y+%3D+500+%2B+%2...

Re:Fujifilm Created a Magnetic Tape That Can Store 580 Terab... by Karunamon on Monday December 28, 2020 @11:52PM (#25566863)
It's not a fair comparison to put up hard drives (integrated mechanics) against tape drives (seprated mechanics). They do not solve the same problem and have different longevity profiles. If I'm spending $500 on tape storage, it's because I want something that will last a long time, something that portable hard drives tend to have issues with.

LTO5 onward supports LTFS, which exposes the tape to the OS as if it were any other removable storage, with the one proviso that deleting files doesn't reclaim space unless the entire tape is wiped.

Re:Fujifilm Created a Magnetic Tape That Can Store 580 Terab... by seg_lol on Tuesday December 29, 2020 @01:01AM (#25567181)
LTFS is ok, a multilevel tar file with a file list followed by an FEC encoded block store would be easier and more portable.

It has been 8+ years since I played with LTFS, so maybe it has improved.

Re:Fujifilm Created a Magnetic Tape That Can Store 580 Terab... by Karunamon on Thursday December 31, 2020 @01:35PM (#25595549)
LTFS as of today is supported in FUSE, which realistically means it works on every OS that matters.
Re:Fujifilm Created a Magnetic Tape That Can Store 580 Terab... by blackrock on Monday December 28, 2020 @07:27PM (#25565089)
True, on hard drives, the controller board will eventually fail. The solders might decompose or the circuitry might fail. Then you’re left with a platter full of randomized bits.

But on tape, the controller mechanism is separated from the storage medium. The controller mechanism is inside the drive readers itself, which will eventually fail.

So for both, it’s a trade off. They’re both going to eventually fail.

Re:Fujifilm Created a Magnetic Tape That Can Store 580 Terab... by monocasa on Monday December 28, 2020 @06:08PM (#25564384)
That $300 drive is an LTO-2 drive. It's so old that it's parallel SCSI.

I'd be surprised if you could even get tapes for it that aren't sketch grey market stuff that you wouldn't want to use for backups anyway.

Re:Fujifilm Created a Magnetic Tape That Can Store 580 Terab... by segfaultbuserr on Monday December 28, 2020 @06:31PM (#25564605)
One day I found a really cheap LTO-4 drive that costed $150. Interesting, but I found it was not practical despite the price and decided against it. First, an 800 GB LTO-4 tape is no longer high density by today's standard, it couldn't even hold a 1 TB HDD image, also, I still had to pay for the necessary SAS peripherals to get it working, finally, the mechanical assembly inside a 10-year-old tape drive was not something that inspires confidence for data backup... Last time I've looked up, the cheapest decommissioned LTO-5 drive still costs $1000.
Re:Fujifilm Created a Magnetic Tape That Can Store 580 Terab... by prirun on Monday December 28, 2020 @06:08PM (#25564390)
The first tape drive is a 200GB (native / uncompessed) internal SCSI drive. Not so easy for a consumer with a laptop to use.

The tapes are pretty cheap at $8 on Amazon if you buy 20.

Re:Fujifilm Created a Magnetic Tape That Can Store 580 Terab... by weare138 on Monday December 28, 2020 @07:01PM (#25564904)
Well they don't really make these things for laptops unfortunately but they also don't cost $25k+ like they used to. It's still more than the average consumer is willing to spend but they are affordable enough now to be a viable option for professionals and small businesses.
Re:Fujifilm Created a Magnetic Tape That Can Store 580 Terab... by dijit on Monday December 28, 2020 @06:01PM (#25564325)
What makes you think I meant home use?
Re:Fujifilm Created a Magnetic Tape That Can Store 580 Terab... by throwaway2245 on Monday December 28, 2020 @06:41PM (#25564706)
The first person pronoun you used ("I") strongly implied personal use.
Re:Fujifilm Created a Magnetic Tape That Can Store 580 Terab... by jtxx on Monday December 28, 2020 @06:50PM (#25564791)
No, it just means the person has the ability to purchase. They could be purchasing it for themselves or on the behalf of another organization.
Re:Fujifilm Created a Magnetic Tape That Can Store 580 Terab... by throwaway2245 on Monday December 28, 2020 @07:00PM (#25564892)
I accept that, in a literal sense.

I was attempting only to answer the question and explain the source of confusion.

In native English speech, it would usually be expected that a business-case purchasor would speak of a more general case, perhaps by using "we".

Re:Fujifilm Created a Magnetic Tape That Can Store 580 Terab... by jtxx on Monday December 28, 2020 @08:55PM (#25565798)
Ah - I took the question as saying “I did nothing to indicate the sort and could in fact be purchasing for a business”, so I was trying to explain that side!
Re:Fujifilm Created a Magnetic Tape That Can Store 580 Terab... by Blikkentrekker on Monday December 28, 2020 @10:01PM (#25566271)
In English, when purchasing on behalf of a corporation, “we” would almost always be used.

“we” is even frequently employed by auctors writing papers to depersonalize.

Re:Fujifilm Created a Magnetic Tape That Can Store 580 Terab... by jtxx on Tuesday December 29, 2020 @12:48AM (#25567128)
I guess it’s just me then. I wouldn’t write “we” in a comment online without explaining who “we” is, it seems like an unnecessary detail to explain
Re:Fujifilm Created a Magnetic Tape That Can Store 580 Terab... by dijit on Tuesday December 29, 2020 @03:57AM (#25567998)
That’s how I meant it. Seems odd to say “we” out of context like that. And anyway I would be the person purchasing so including the whole company is.. odd.

Anyway, I guess this is the pedantry we (!) should expect from HN

Re:Fujifilm Created a Magnetic Tape That Can Store 580 Terab... by klodolph on Monday December 28, 2020 @06:56PM (#25564859)
> Swapping tapes continues to be human intensive and restore times long.

Restore times are definitely long, but you can mostly avoid human labor by putting the tapes in a tape library, which will load tapes in the drives using robots. You still need technicians around because tapes / drives / robots will break, but individual restore operations can be completely automated.

Re:Fujifilm Created a Magnetic Tape That Can Store 580 Terab... by chrisseaton on Monday December 28, 2020 @05:32PM (#25564042)
Doesn't really sound like it's aimed at you. Tape is for serious long-term, high-volume storage. If you've got a limited budget for the tape device it's probably not designed for you in the first place.
Re:Fujifilm Created a Magnetic Tape That Can Store 580 Terab... by throwaway2245 on Monday December 28, 2020 @06:44PM (#25564727)
I understood the exact opposite that you have understood, and I find your comment quite uncomfortable, as a result?

The parent is clearly seeking to confirm serious long-term use, as you say, in considering the costs of failure cases.

Re:Fujifilm Created a Magnetic Tape That Can Store 580 Terab... by chrisseaton on Monday December 28, 2020 @06:45PM (#25564739)
> I understood the exact opposite that you have understood, and I find your comment quite uncomfortably presumptuous, as a result?

Is this a question? I can't tell you if that's how you find my comment or not, sorry.

They wants a cheap tape device because they just want to use it in the home. Tape devices aren't cheap... because they aren't aimed at use just in the home.

They aren't aiming at home users - I think that's a simple fact not presuming anything.

Re:Fujifilm Created a Magnetic Tape That Can Store 580 Terab... by throwaway2245 on Monday December 28, 2020 @06:52PM (#25564808)
The parent clarifies above that they are not a home user.

Even if you believed they were a home user, they clearly demonstrated in their original comment that they did know that it was for long-term, high volume storage, and they did know the cost, and you appeared still to belittle them for not knowing.

It's a question in the sense of - why did you choose to say it in this way, which seemed impolite? What did you intend your comment to add?

Re:Fujifilm Created a Magnetic Tape That Can Store 580 Terab... by GordonS on Monday December 28, 2020 @05:37PM (#25564089)
Is it possible to buy tape drives in the 2nd hand market for a reasonable price?
Re:Fujifilm Created a Magnetic Tape That Can Store 580 Terab... by bombcar on Monday December 28, 2020 @08:16PM (#25565473)
It is - the kicker is (and always has been) the media.