News for hackers. Stuff that matters.
Re:256TB SSD from Samsung by rbanffy on Friday August 11, 2023 @04:34PM (#37093662)
While I agree, it's been hard filling up the 2TB drive in my laptop.

My home server has a couple dozen terabytes (on spinning metal) and, with current fill rate, it's predicted it'll need an increase in space only after two of the drives reach retirement according to SMART. It hosts multiple development VMs and stores backups for all computers in the house.

Another aspect is that the total write lifetime is a multiple of the drive capacity. You can treat a 256TB drive as a very durable 16TB drive, able to last 16 times more writes than the 16TB one.

Re:256TB SSD from Samsung by FirmwareBurner on Friday August 11, 2023 @04:37PM (#37093696)
>While I agree, it's been hard filling up the 2TB drive in my laptop.

Then you're defiantly not torrenting enough (definitely legit) content as I am. Once you sail the dark seas it piles up quick. Or maybe I have ADHD.

Re:256TB SSD from Samsung by alternatetwo on Friday August 11, 2023 @04:41PM (#37093732)
Or just download a few modern games.

No torrents here, absolutely none.

Re:256TB SSD from Samsung by FractalParadigm on Friday August 11, 2023 @04:44PM (#37093766)
I think, for me, it satisfies some kind of hoarding instinct. I have a hard time keeping 'random junk' laying around my apartment, but I have absolutely no problem keeping a copy of a DVD I ripped 15 years ago that I will probably never watch again, and would probably be upset if it disappeared for some reason.
Re:256TB SSD from Samsung by TeMPOraL on Friday August 11, 2023 @04:51PM (#37093846)
Don't even have to set your sail; this landlubber likes likes to shoot videos with a smartphone, and these days, recording a few minutes of a family event, or even your plane taking off, in decent quality, will easily give you a multi-gigabyte video file. And that's for normal videos; $deity help you if you enable HDR.

And yes, this is the universal answer to "how much storage is enough" - use cases will grow to consume generally-available computing resources. Today it's 4k UHD + HDR; tomorrow it'll be 8k UHD + HDR, few years later it will be 120 FPS lightfield recording with separate high-resolution radar depth map channel. And as long as progress in display tech keeps pace, the benefits will be apparent, and adoption will be swift.

Re:256TB SSD from Samsung by bob-09 on Friday August 11, 2023 @04:59PM (#37093943)
I'll be curious to see the file sizes for Apple's version of 3D video capture in their Vision goggles. After one, two or three generations, I'm sure the first gen files will look small and lacking.
Re:256TB SSD from Samsung by rbanffy on Friday August 11, 2023 @05:47PM (#37094460)
Of course. It won't encode touch and smell.
Re:256TB SSD from Samsung by jaggederest on Friday August 11, 2023 @08:07PM (#37095535)
I've actually found my videos are not increasing as rapidly as I would expect. I've been reencoding in x265 and the file size difference is shocking. Right now I'm not ditching the existing original files but I may do that at some point, or just offload to a cloud service like Glacier
Re:256TB SSD from Samsung by tokamak-teapot on Saturday August 12, 2023 @06:05AM (#37098655)
I’m right up next to a limit on live (easily-accessible, always visible in photo apps) cloud storage, with years of family photos and video taking about 95% of that.

I definitely don’t want to delete any of it, so I have been just hoping for bigger storage to be offered soon, but…

I hadn’t considered that re-encoding could be an option. I take standalone snapshots of everything every few months so if re-encoding would make a significant difference I might have to try this.

Do you have any tips on tools, parameters etc. that work well for you, please?

Re:256TB SSD from Samsung by jaggederest on Saturday August 12, 2023 @01:21PM (#37102306)
I use a shell script with ffmpeg. I encourage you to check out what works best for you but honestly the quality is pretty stellar with just a really simple one like

    mkdir -p reencoded

    ffmpeg -i input_filename.mp4 -c:v libx265 -crf 26 -preset fast -c:a aac -b:a 128k reencoded/output_filename.mp4
That's a fast single-pass constant quality encode - a two-pass encode would be better quality for the size but I find that very acceptable. It knocks down what would be a ~2gb file all the way to between 800mb - 1200mb with very reasonable quality, sometimes even more - I've seen a 5gb file become a 400mb file (!!). You can experiment with the -crf 26 parameter to get the quality/size tradeoff you like. I run that over every video in the directory as a cron job basically.
Re:256TB SSD from Samsung by ipaddr on Friday August 11, 2023 @04:37PM (#37093703)
Once you start saving media or playing with ai models space goes quickly.
Re:256TB SSD from Samsung by rbanffy on Friday August 11, 2023 @04:49PM (#37093821)
That's what the server is for.
Re:256TB SSD from Samsung by TeMPOraL on Friday August 11, 2023 @04:57PM (#37093926)
And there are many reasons for one to prefer having their workstation be their server.
Re:256TB SSD from Samsung by rbanffy on Friday August 11, 2023 @05:49PM (#37094473)
In fairness, it has a screen and keyboard connected, but no mouse. Adding a mouse would be trivial.

Anyway, 20TB takes a 3.5" bay, something my laptop lacks.

Re:256TB SSD from Samsung by dbg31415 on Friday August 11, 2023 @04:38PM (#37093712)
Oh look at Mr. “I pay legitimate streaming services for all my tv shows and movies” over there. (=

I have a 12 TB NAS that is 99% full at the moment. Should I delete movies I may want to watch later, knowing full well they aren’t easily available on the streaming services I pay for? Ha.

It fills fast!

Re:256TB SSD from Samsung by pixl97 on Friday August 11, 2023 @04:45PM (#37093788)
The people streaming their data are just using someone else's SSD... at the end of the day all this data we generate and consume sits somewhere
Re:256TB SSD from Samsung by rbanffy on Friday August 11, 2023 @05:50PM (#37094491)
I'm also deduplicating that data by not storing it locally.
Re:256TB SSD from Samsung by tbyehl on Friday August 11, 2023 @04:50PM (#37093832)
Sounds like you need a bigger NAS. I throw a fresh 10TB drive in mine every 3-4 months.
Re:256TB SSD from Samsung by dbg31415 on Friday August 11, 2023 @04:54PM (#37093882)
Start. Smart to cycle drives out after 3 years too.
Re:256TB SSD from Samsung by tbyehl on Friday August 11, 2023 @05:00PM (#37093963)
I'm thrifty, I buy drives that businesses already cycled out after 3-5 years.
Re:256TB SSD from Samsung by dbg31415 on Friday August 11, 2023 @05:06PM (#37094031)
You laugh in the face of danger; a real risk taker! (=

I love all the Backblaze drive update posts about the lifespans of storage media.

Re:256TB SSD from Samsung by tbyehl on Friday August 11, 2023 @08:34PM (#37095703)
Usenet is my backup. I've tried to make Backblaze my backup a couple times but the ETA on completing the first pass is always right about never.
Re:256TB SSD from Samsung by rbanffy on Friday August 11, 2023 @10:05PM (#37096235)
It's interesting to think that, as flash densities surpass hard disks, it'll become cheaper to store data on flash than on spinning metal once you factor in rack space and power consumption.

Won't take that long.

Re:256TB SSD from Samsung by rbanffy on Friday August 11, 2023 @04:52PM (#37093865)
For the kind of usage a streaming device has, an SSD is overkill. For that, spinning metal is probably a better choice. OTOH, 256TB of spinning metal take up space and is quite noisy.
Re:256TB SSD from Samsung by ls612 on Friday August 11, 2023 @06:13PM (#37094712)
They have 16TB NAS drives for $300 now so if you have decent disposable income just upgrading the drives one by one is probably a decent strategy.
Re:256TB SSD from Samsung by xbkingx on Friday August 11, 2023 @04:50PM (#37093844)
Blu-rays can take up 25gb each, so just a decent collection of those could easily consume most of one of these drives. If you want to do basic model tuning in stable diffusion, each model variation can take 7gb. This level of storage would mean you could almost setup a versioning system for those. And finally, any work with uncompressed data, which can just be easier in general, could benefit from it.
Re:256TB SSD from Samsung by rbanffy on Saturday August 12, 2023 @06:24PM (#37104766)
256TB is 10,000 25GB BD movies.

Even with brand new 25TB 3.5" drives, it's 10 of them, each holding 1,000 movies, for a total of 20,000 hours of entertainment or, roughly, 2 years of uninterrupted watching.

That's a lot.