News for hackers. Stuff that matters.
Re:CERN serves 1EB of data via FUSE [video] by pas on Tuesday October 01, 2024 @10:48PM (#41716708)
slide 22 states that the cost is 1 CHF/TB/month (on 10+2 erasure coded disks), though it would be interesting to do a breakdown of costs (development, hardware, maintenance, datacenter, servicing, management, etc..)
Re:CERN serves 1EB of data via FUSE [video] by pclmulqdq on Wednesday October 02, 2024 @12:08AM (#41717064)
1 CHF/TB/month is a bit expensive for storage at that scale, so it would definitely be interesting to see what they're spending the money on and what they are (and aren't) counting in that price.
Re:CERN serves 1EB of data via FUSE [video] by hackernewds on Wednesday October 02, 2024 @12:23AM (#41717152)
No budget often tags along with no accountability
Re:CERN serves 1EB of data via FUSE [video] by rob_c on Wednesday October 02, 2024 @02:23AM (#41717734)
Tape backup, accessibility, networking, availability... At 1CHF/TB that's a lot better than my local university still charging >100x that for such services internally
Re:CERN serves 1EB of data via FUSE [video] by pclmulqdq on Wednesday October 02, 2024 @09:42AM (#41720584)
Economies of scale in storage are significant. Also, I don't know why you put up with your university charging 100x that when you can store things on AWS for $5-10/TB/month (or less). That comes with all the guarantees (or more) of durability and availability you get from the university.
Re:CERN serves 1EB of data via FUSE [video] by lnauta on Wednesday October 02, 2024 @06:32PM (#41725542)
Don't forget bandwidth costs at this scale are significant to say the least.
Re:CERN serves 1EB of data via FUSE [video] by pclmulqdq on Wednesday October 02, 2024 @11:42PM (#41727180)
I assume most of that exabyte is stored in 2-3 datacenters, in which case the bandwidth cost is actually relatively small. Downloading it would cost a fortune (or take an eternity), but if it stays in the datacenter (or stays in AWS), bandwidth is cheap.