News for hackers. Stuff that matters.
Re:Fujifilm Created a Magnetic Tape That Can Store 580 Terab... by vondur on Monday December 28, 2020 @05:29PM (#25564018)
This is geared for enterprise settings, not home use. I believe someone mentioned these drives costing $25,000. I do agree reasonably priced tape drives with TB of space for home users would be great.
Re:Fujifilm Created a Magnetic Tape That Can Store 580 Terab... by weare138 on Monday December 28, 2020 @05:59PM (#25564304)
The prices are much cheaper now. You can get a single tape drive for under $300 and enterprise grade single tape drives for under $3k.

https://www.newegg.com/p/2BM-000A-000M5

https://www.provantage.com/quantum-tc-l72an-br~7QUAT0JW.htm

Re:Fujifilm Created a Magnetic Tape That Can Store 580 Terab... by ardy42 on Monday December 28, 2020 @06:52PM (#25564810)
> The prices are much cheaper now. You can get a single tape drive for under $300 and enterprise grade single tape drives for under $3k.

Those tapes only hold 200 GB, and you can get a 10 TB hard drive today for less than $300:

https://www.newegg.com/red-wd101efax-10tb/p/N82E16822234407

While tapes are theoretically cool, the the drives are just too rare for them to be of any practical value to a home user. Even if the media has a better archival life than a hard disk (say 50 years), it won't do you a damn bit of good if there are no drives available in 50 years to read it.

IMHO, hard drives are better for backup (even offline backup, just get a hot-swap bay and imagine the drive is tape [1]). Archival is a harder problem, but I've settled on using high-grade optical media, burned slow for fewer errors, making a bunch of redundant copies. Even though the media might not last as long, I'm pretty much guaranteed to be able to find a drive for the next several decades [2].

[1] "pretend this hard drive is a tape" is even an enterprise product: https://en.wikipedia.org/wiki/RDX_Technology

[2] For instance, you can still attach a 5.25 floppy drive to a modern computer: https://www.ebay.com/sch/i.html?_nkw=5.25+floppy+drive + http://www.deviceside.com/fc5025.html

Re:Fujifilm Created a Magnetic Tape That Can Store 580 Terab... by klodolph on Monday December 28, 2020 @07:11PM (#25564974)
> Those tapes only hold 200 GB, and you can get a 10 TB hard drive today for less than $300:

That was a link to an obsolete LTO-2 drive. If you’re using LTO-8, which is the current generation, you’d get a 10-pack of 12TB tapes for around $500. Noticeably cheaper per byte than hard drives.

I don’t recommend LTO-2 just because I don’t think that the drives are well-supported.

> While tapes are theoretically cool, the the drives are just too rare for them to be of any practical value to a home user. Even if the media has a better archival life than a hard disk (say 50 years), it won't do you a damn bit of good if there are no drives available in 50 years to read it.

If you’re evaluating just on the basis of the price of drives / media, then there’s a cutoff where tape becomes cheaper than hard drives. The easy way to calculate this cutoff is to divide the overhead cost (tape drive price) by the difference in the cost per TB of tapes and hard drives, which in the example here, is around $3k divided by $25/TB, or 120 TB.

In other words, if you have more than about 120 TB of data, then it is cheaper to buy a tape drive. I think any comments about whether tape drives are suitable for home use are really comments about whether you are interested in the use case of people who need to store >120 TB at home.

If you are running a YouTube channel as a hobby, or you run a side business doing videography for weddings, the tape drive starts to sound a lot better. The 120 TB cutoff might be around 300 hours of video, which might be only 50 events.

There are a lot of other reasons why you might NOT want to use tape, but it’s easy to have enough data that tape is the cheapest storage option. At “enterprise” scale the cost calculus is completely different and involves things like support contracts with Oracle (not necessary for hard drives), power/cooling in your DC (tape is very low-power), etc.

And let’s not forget that if you have 120TB of hard drives, you’re in the regime where you start having to buy multiple machines.

As for longetivity—I don’t have the data handy. If you are storing data on tape, you need to migrate to newer generations of tape, as old generations become obsolete and unavailable. If you are storing on hard disks, you also need to migrate because hard disks eventually fail (even if they are not powered on).

Re:Fujifilm Created a Magnetic Tape That Can Store 580 Terab... by ardy42 on Monday December 28, 2020 @07:33PM (#25565129)
> That was a link to an obsolete LTO-2 drive. If you’re using LTO-8, which is the current generation, you’d get a 10-pack of 12TB tapes for around $500. Noticeably cheaper per byte than hard drives.

But it looks like the cheapest drive on Newegg for that is $3,299.00: https://www.newegg.com/p/2BM-0046-00001

> In other words, if you have more than about 120 TB of data, then it is cheaper to buy a tape drive. I think any comments about whether tape drives are suitable for home use are really comments about whether you are interested in the use case of people who need to store >120 TB at home.

> If you are running a YouTube channel as a hobby, or you run a side business doing videography for weddings, the tape drive starts to sound a lot better. The 120 TB cutoff might be around 300 hours of video, which might be only 50 events.

No dispute there, but I think most >120 TB home use cases run into the question of if it's even worth it to keep the data (raw/uncompressed). For most people, the answer is probably no, and curation/compression makes far more sense. For instance, I don't think it's even typical for wedding photographers/videographers to store their final product indefinitely, let alone the raw footage for a re-edit. You can keep a lot more events in a lot less space if you're only keep the raw footage for a few recent events and the 15-30 minute final edit for a year after it's finalized.

> And let’s not forget that if you have 120TB of hard drives, you’re in the regime where you start having to buy multiple machines.

Not if you swap disks as offline storage.

> As for longetivity—I don’t have the data handy. If you are storing data on tape, you need to migrate to newer generations of tape, as old generations become obsolete and unavailable. If you are storing on hard disks, you also need to migrate because hard disks eventually fail (even if they are not powered on).

Honestly, the theoretical longevity is the only aspect of tape that appeals to me, but like you said enterprise tapes will end up being like these enterprise optical disks in a fairly short period of time, so you're regularly going to have migration legwork to do or your data's effectively toast.

https://twitter.com/foone/status/1236524992709316608

Re:Fujifilm Created a Magnetic Tape That Can Store 580 Terab... by Karunamon on Monday December 28, 2020 @10:42PM (#25566489)
You don't even need the absolute latest drives to get reasonable storage volumes. Some careful shopping can net you an LTO-5 (1.5TB native capacity) library unit (one that can be upgraded to newer generations) for under $500, with new tapes $10-15 each.

The nice thing about LTO as a format is its relative predictability and ease of acquiring the parts, even the very obsolete ones. It's all SCSI or SAS, most of the interesting stuff happens at the hardware level, with a bog-standard API. Your average backup app, whether it be Backup Exec or mtx/tar/etc. on Linux doesn't need to care about the media format. Unlike actual "enterprise" shops with datacenters and support contracts and such cruft, where the primary concern is "does it work", it is fine to buy older units second-hand. They are plentiful and cheap.

Re:Fujifilm Created a Magnetic Tape That Can Store 580 Terab... by gruez on Monday December 28, 2020 @11:39PM (#25566791)
> You don't even need the absolute latest drives to get reasonable storage volumes. Some careful shopping can net you an LTO-5 (1.5TB native capacity) library unit (one that can be upgraded to newer generations) for under $500, with new tapes $10-15 each.

That's still... pretty terrible. If we compare you costs for a tape drive against a 14TB easystore @ $190[1], the break-even point is around 72TB. I don't know about you, but that's of data you have to store for it to be worth it. Even at 150TB you're only looking at around ~25% (~$500) in savings compared to hard drive, which I don't think is much when you factor in how much of a hassle tape drives are to work with.

[1] https://slickdeals.net/f/14587381-14tb-wd-easystore-external...

[2] https://www.wolframalpha.com/input/?i=solve+y+%3D+500+%2B+%2...

Re:Fujifilm Created a Magnetic Tape That Can Store 580 Terab... by Karunamon on Monday December 28, 2020 @11:52PM (#25566863)
It's not a fair comparison to put up hard drives (integrated mechanics) against tape drives (seprated mechanics). They do not solve the same problem and have different longevity profiles. If I'm spending $500 on tape storage, it's because I want something that will last a long time, something that portable hard drives tend to have issues with.

LTO5 onward supports LTFS, which exposes the tape to the OS as if it were any other removable storage, with the one proviso that deleting files doesn't reclaim space unless the entire tape is wiped.

Re:Fujifilm Created a Magnetic Tape That Can Store 580 Terab... by seg_lol on Tuesday December 29, 2020 @01:01AM (#25567181)
LTFS is ok, a multilevel tar file with a file list followed by an FEC encoded block store would be easier and more portable.

It has been 8+ years since I played with LTFS, so maybe it has improved.

Re:Fujifilm Created a Magnetic Tape That Can Store 580 Terab... by Karunamon on Thursday December 31, 2020 @01:35PM (#25595549)
LTFS as of today is supported in FUSE, which realistically means it works on every OS that matters.
Re:Fujifilm Created a Magnetic Tape That Can Store 580 Terab... by blackrock on Monday December 28, 2020 @07:27PM (#25565089)
True, on hard drives, the controller board will eventually fail. The solders might decompose or the circuitry might fail. Then you’re left with a platter full of randomized bits.

But on tape, the controller mechanism is separated from the storage medium. The controller mechanism is inside the drive readers itself, which will eventually fail.

So for both, it’s a trade off. They’re both going to eventually fail.

Re:Fujifilm Created a Magnetic Tape That Can Store 580 Terab... by monocasa on Monday December 28, 2020 @06:08PM (#25564384)
That $300 drive is an LTO-2 drive. It's so old that it's parallel SCSI.

I'd be surprised if you could even get tapes for it that aren't sketch grey market stuff that you wouldn't want to use for backups anyway.

Re:Fujifilm Created a Magnetic Tape That Can Store 580 Terab... by segfaultbuserr on Monday December 28, 2020 @06:31PM (#25564605)
One day I found a really cheap LTO-4 drive that costed $150. Interesting, but I found it was not practical despite the price and decided against it. First, an 800 GB LTO-4 tape is no longer high density by today's standard, it couldn't even hold a 1 TB HDD image, also, I still had to pay for the necessary SAS peripherals to get it working, finally, the mechanical assembly inside a 10-year-old tape drive was not something that inspires confidence for data backup... Last time I've looked up, the cheapest decommissioned LTO-5 drive still costs $1000.
Re:Fujifilm Created a Magnetic Tape That Can Store 580 Terab... by prirun on Monday December 28, 2020 @06:08PM (#25564390)
The first tape drive is a 200GB (native / uncompessed) internal SCSI drive. Not so easy for a consumer with a laptop to use.

The tapes are pretty cheap at $8 on Amazon if you buy 20.

Re:Fujifilm Created a Magnetic Tape That Can Store 580 Terab... by weare138 on Monday December 28, 2020 @07:01PM (#25564904)
Well they don't really make these things for laptops unfortunately but they also don't cost $25k+ like they used to. It's still more than the average consumer is willing to spend but they are affordable enough now to be a viable option for professionals and small businesses.
Re:Fujifilm Created a Magnetic Tape That Can Store 580 Terab... by dijit on Monday December 28, 2020 @06:01PM (#25564325)
What makes you think I meant home use?
Re:Fujifilm Created a Magnetic Tape That Can Store 580 Terab... by throwaway2245 on Monday December 28, 2020 @06:41PM (#25564706)
The first person pronoun you used ("I") strongly implied personal use.
Re:Fujifilm Created a Magnetic Tape That Can Store 580 Terab... by jtxx on Monday December 28, 2020 @06:50PM (#25564791)
No, it just means the person has the ability to purchase. They could be purchasing it for themselves or on the behalf of another organization.
Re:Fujifilm Created a Magnetic Tape That Can Store 580 Terab... by throwaway2245 on Monday December 28, 2020 @07:00PM (#25564892)
I accept that, in a literal sense.

I was attempting only to answer the question and explain the source of confusion.

In native English speech, it would usually be expected that a business-case purchasor would speak of a more general case, perhaps by using "we".

Re:Fujifilm Created a Magnetic Tape That Can Store 580 Terab... by jtxx on Monday December 28, 2020 @08:55PM (#25565798)
Ah - I took the question as saying “I did nothing to indicate the sort and could in fact be purchasing for a business”, so I was trying to explain that side!
Re:Fujifilm Created a Magnetic Tape That Can Store 580 Terab... by Blikkentrekker on Monday December 28, 2020 @10:01PM (#25566271)
In English, when purchasing on behalf of a corporation, “we” would almost always be used.

“we” is even frequently employed by auctors writing papers to depersonalize.

Re:Fujifilm Created a Magnetic Tape That Can Store 580 Terab... by jtxx on Tuesday December 29, 2020 @12:48AM (#25567128)
I guess it’s just me then. I wouldn’t write “we” in a comment online without explaining who “we” is, it seems like an unnecessary detail to explain
Re:Fujifilm Created a Magnetic Tape That Can Store 580 Terab... by dijit on Tuesday December 29, 2020 @03:57AM (#25567998)
That’s how I meant it. Seems odd to say “we” out of context like that. And anyway I would be the person purchasing so including the whole company is.. odd.

Anyway, I guess this is the pedantry we (!) should expect from HN