News for hackers. Stuff that matters.
Re:Cloud Storage for $2 per TB per month by arcticbull on Friday March 06, 2020 @04:32PM (#22507511)
Here's the issue. We know that due to economy of scale and domain experience, AWS will always have the lowest cost (to Amazon) for storage -- whether that's totally-reliable storage, or sorta-reliable. If there was a demand for sorta-reliable, they'd build a sorta-reliable S3 and undercut you. Then, blockchain adds inefficiency. Therefore, it's basically impossible for any blockchain solution to have a lower total cost to provide storage.
Re:Cloud Storage for $2 per TB per month by Dylan16807 on Friday March 06, 2020 @08:14PM (#22508989)
> If there was a demand for sorta-reliable, they'd build a sorta-reliable S3 and undercut you.

Amazon's goal is to get people to pay a premium to get access to their entire ecosystem of services. They don't optimize the price of each individual service. There's a lot of take it or leave it for their specific offerings. Look at how they used to have reduced redundancy as a cost saver, but don't anymore. If you want corner-cutting storage from Amazon, you get funneled into Glacier now.

So let's look at how glacier deep archive is $.99 per TB per month, with a waiting time. And Google's weird offering where it costs $1.23 per TB per month, with instant access, but you pay a bunch of money to access. That means they can't store it on tapes, but they expect to profit anyway. And they're probably not running that as a loss leader that depends on the archival data being accessed.

Re:Cloud Storage for $2 per TB per month by manigandham on Saturday March 07, 2020 @01:07AM (#22510084)
S3 Reduced Redundancy is replaced with S3 Infrequent Access (and another lower tier One-Zone Infrequent Access) so there's still some pricing flexibility available.
Re:Cloud Storage for $2 per TB per month by Dylan16807 on Saturday March 07, 2020 @01:20AM (#22510119)
Infrequent Access is closer. But wow, one-zone sure is only 20% cheaper than three-zone. And the retrieval cost is significantly more expensive than glacier's bulk price.

Actually, looking closer, is one-zone even storing fewer copies? It's offering the same durability, except in the case of "availability zone destruction". So if they're selling three copies for $10 a TB, then the equivalent price for 64-of-96 would be $5 a TB. Cutting that down with cheaper worse hardware would go a long way to get you toward the $2 goal.

Re:Cloud Storage for $2 per TB per month by manigandham on Saturday March 07, 2020 @03:27AM (#22510552)
S3 Standard and S3 IA store multiple copies spread across 3 zones. S3 One-Zone IA is stored as multiple copies but all within a single zone. They give you the same technical durability but less availability if that zone goes down, and if it's destroyed then you lose all your data.
Re:Cloud Storage for $2 per TB per month by hinkley on Saturday March 07, 2020 @07:23PM (#22515259)
That has the potential to cut both ways. If Amazon decides that S3 is their loss leader, then they would absolutely bury boutique players who only cover a few functional areas.

If instead they decide it's the cash cow, then it wouldn't be a stretch to predict that they price it a bit above the competition. The customer has the impression that they can amortize the cost across the other value-adds in the ecosystem. Whether the customer is right or not barely matters to Amazon from a purely financial aspect. All that matters is that they believe it to be true.

There's also the short-term versus the long term strategy. Short term they could do either and I wouldn't be surprised. Long term, I think I would expect the latter.

Re:Cloud Storage for $2 per TB per month by NohatCoder on Saturday March 07, 2020 @11:21AM (#22512325)
Where did you get those prices? I can't find anything cheaper than $4 per TB month at both Google and Amazon.
Re:Cloud Storage for $2 per TB per month by Dylan16807 on Saturday March 07, 2020 @01:17PM (#22513045)
https://aws.amazon.com/s3/pricing/

Glacier Deep Archive is .99/TB/month in US East and EU Ireland and several others, plus $2.50/TB bulk retrieval.

https://cloud.google.com/storage/pricing

Archive Storage is $1.20/TB/month in us-east1 and europe-west1 and several others. But (instant) retrieval is $50/TB, with no options...

Re:Cloud Storage for $2 per TB per month by throwaway9878 on Friday March 06, 2020 @04:41PM (#22507601)
Everybody with more money than you can always undercut you in anything you ever do so why bother ever trying to do anything
Re:Cloud Storage for $2 per TB per month by enaaem on Friday March 06, 2020 @06:57PM (#22508538)
Very good point! Let's say you move into a new market, trying to undercut the status quo. The status quo, with their power of scale and experience can just undercut you back. Who is benefitting from this? The customers! So if the customers want more competition they have to pay you to play. Which means they have to co-invest with you and promise to buy your service later.

A good is example are the Apple iPhone screens. If Apple wants a new competing supplier, they have to invest in new competitors.

Re:Cloud Storage for $2 per TB per month by nojvek on Saturday March 07, 2020 @02:43PM (#22513572)
Not really. Suppose giant A undercuts startup B where A is making a temporary loss but B runs out of money trying to complete, only A remains in the market and A starts charging a premium since it doesn’t have completion.

This is bad for customers in the long term. Like how Amazon is slowly destroying brick and mortar stores, or having Amazon Basics at the front undercutting other sellers. Monopolies mean you don’t have an open fair market anymore.

Re:Cloud Storage for $2 per TB per month by enaaem on Sunday March 08, 2020 @07:35AM (#22517533)
It's true that benefits for customers would likely be only temporary. But that is not my main point.

I'm explaining a common business move called pay to play, in industries that require very high investments for new competitors. If customers want B to compete, they have to pay B first to ensure B does not make a loss, so everyone wins a little in the end.

So in the case of OP. He needs to finds paying customers first, who are willing to pre-order his service.

Re:Cloud Storage for $2 per TB per month by nemonemo on Friday March 06, 2020 @04:49PM (#22507659)
I think the point is that the cost should not be the main motivator. I would agree that there needs to be other differentiators in addition to cost, which could provide sufficient moat against other competitors, big or small.
Re:Cloud Storage for $2 per TB per month by jessriedel on Friday March 06, 2020 @05:04PM (#22507768)
It's possible that there could be non-obvious innovations in how to save money with a low reliability threshold, which Amazon might not be able to effortlessly copy.
Re:Cloud Storage for $2 per TB per month by res0nat0r on Friday March 06, 2020 @06:05PM (#22508213)
It should also be noted that you can get S3 storage for $1/TB/month already if you use the Glacier Deep Archive storage class.
Re:Cloud Storage for $2 per TB per month by paulryanrogers on Friday March 06, 2020 @06:26PM (#22508351)
Did that include network IO to retrieve your data?
Re:Cloud Storage for $2 per TB per month by notyourday on Friday March 06, 2020 @08:30PM (#22509075)
Nope. That's what actually kills you on Amazon - network costs.
Re:Cloud Storage for $2 per TB per month by Dylan16807 on Saturday March 07, 2020 @01:47AM (#22510208)
It's... interesting... that Amazon offers reasonably priced bandwidth on Lightsail, but it's against the TOS to use it in connection with other services.
Re:Cloud Storage for $2 per TB per month by notyourday on Saturday March 07, 2020 @07:04AM (#22511180)
Yeah, I have been proxy accessing my personal S3 that way, but I'm not really willing to bet a business on it.
Re:Cloud Storage for $2 per TB per month by zadokshi on Saturday March 07, 2020 @04:12PM (#22514102)
Not really. Have you ever done the maths on what it costs to recover 1TB in a recovery situation.

Definitely not worth it.

Re:Cloud Storage for $2 per TB per month by Dylan16807 on Saturday March 07, 2020 @08:47PM (#22515713)
Putting it into normal S3 only costs $2.50 a TB. That's very affordable.

To get out of Amazon entirely, they definitely want to gouge you, but it's not the end of the world. If $24 a year is an acceptable storage price, then Snowball export costing somewhere around $36/TB in bulk isn't too awful. (And if you don't have enough data to fill up a snowball, you can probably smuggle it out through lightsail.)

Re:Cloud Storage for $2 per TB per month by arcticbull on Friday March 06, 2020 @04:57PM (#22507718)
My point is taking something, adding inefficiency, then pronouncing it's "cheapest in class" isn't logically possible.
Re:Cloud Storage for $2 per TB per month by badestrand on Friday March 06, 2020 @10:15PM (#22509498)
You are confusing "cheapest option possible" with "cheapest option available". Maybe Amazon _could_ be cheapest and most efficient in everything but they aren't, that's why they make a lot of profit with their cloud services. Thus there can easily be a competitor with a cheaper offering, especially if they are cutting some corners as per the article, even if they have some inefficiencies in other areas.
Re:Cloud Storage for $2 per TB per month by paxys on Friday March 06, 2020 @05:24PM (#22507915)
The point is not to do it cheaper but better.
Re:Cloud Storage for $2 per TB per month by wju3h3uwh on Friday March 06, 2020 @06:55PM (#22508526)
Quantity is a type of quality. Lots of people mainly use cloud storage as a cold storage locker for backing up photos and documents. I'm sure there's ways to innovate in the space that would make certain clouds more appealing, but most solutions are already effective as simple storage lockers. Doing it better instead of cheaper at this point is more likely to be either a megacorp affiliation perk, like a discount on a YouTube Music subscription, or phone company style family plan discounts "Get discounted storage for the whole family if you pay slightly less than the price of four memberships!"
Re:Cloud Storage for $2 per TB per month by arcticbull on Friday March 06, 2020 @06:32PM (#22508389)
... better than AWS with its SLAs, that every major company relies on to some extent?
Re:Cloud Storage for $2 per TB per month by paxys on Friday March 06, 2020 @06:48PM (#22508484)
Yes. There's a reason companies like Digital Ocean, Heroku, OVH, ZEIT, Joyent, Rackspace, Linode, Cloudflare and many more have been able to survive and grow rapidly in an AWS-dominated space. None of them are competing by undercutting Amazon in price.
Re:Cloud Storage for $2 per TB per month by folmar on Thursday March 19, 2020 @04:14PM (#22631200)
OVH is certainly undercutting Amazon in price. The free bandwidth included in each instance is already a dealbreaker if you actually use the instance for anything other than very heavy cpu-bound loads with small output to send back.
Re:Cloud Storage for $2 per TB per month by DarthGhandi on Friday March 06, 2020 @08:38PM (#22509120)
Re:Cloud Storage for $2 per TB per month by Dylan16807 on Saturday March 07, 2020 @12:25AM (#22509936)
"Better" in a niche-filling way, not a "this is very well engineered, but for my use case it's very overengineered" way.
Re:Cloud Storage for $2 per TB per month by vincentlee on Friday March 06, 2020 @08:16PM (#22509000)
market your product better, steal better companies people, lie, play political games, leverage relationships, kill

so many options

Re:Cloud Storage for $2 per TB per month by yourapostasy on Friday March 06, 2020 @05:22PM (#22507895)
> ...they'd build a sorta-reliable S3...

From operational experience reports of S3 I've seen out there and discussions [1], including on HN [2], once you reach a large enough object count, S3 is "sorta-reliable". Objects will disappear. The durability claim is not SLA-enforced [3], which is uptime-oriented. The only remedy is a service credit.

[1] https://www.theregister.co.uk/2018/07/19/data_durability_sta...

[2] https://news.ycombinator.com/item?id=14880617

[3] https://aws.amazon.com/s3/sla/

Re:Cloud Storage for $2 per TB per month by dannyw on Saturday March 07, 2020 @04:36AM (#22510801)
Had about 20k objects and lost one (405s no matter what) about six month in.

I didn’t think much about it, but I guess I was really unlucky.

Re:Cloud Storage for $2 per TB per month by kmod on Friday March 06, 2020 @05:12PM (#22507829)
I agree that AWS has economies of scale that makes it hard to build a better/cheaper S3, but one way you can get around this problem is by building to lesser requirements. S3 has to work for all use cases, but if you know you need less of something costly (say, less IOPs) you can build a system that's cheaper than S3 even if the individual components are more expensive than S3 is paying.
Re:Cloud Storage for $2 per TB per month by notyourday on Friday March 06, 2020 @05:28PM (#22507933)
This is actually not correct.

Because of AWS scale it cannot be the cheapest. Amazon cannot use odd lots or small lots, which means that it has very few possible suppliers and those suppliers will never be the cheapest.

Same goes for the network infrastructure. While it is possible buy 100Gbit/sec at a throw away price to because some sales person needs to make his numbers and neither he nor his director of sales thinks Kmod Hosting would be able to fill the pipe it is buying, Amazon would need 900Gbit/sec for their exit and no one at the vendor is going to blink at making Amazon pay higher price than Kmod Hosting.

Re:Cloud Storage for $2 per TB per month by late2part on Friday March 06, 2020 @06:53PM (#22508513)
you are wrong that AWS pays more than small vendors.
Re:Cloud Storage for $2 per TB per month by jjeaff on Saturday March 07, 2020 @01:00AM (#22510058)
That's not what they said. They pay more than small vendors, sometimes.

If you are able to take advantage of sales and clearance deals here and there, you are very likely to get a lower price than even the biggest buyers.

Re:Cloud Storage for $2 per TB per month by dannyw on Saturday March 07, 2020 @04:33AM (#22510792)
1 month of sales hunting has got me a PC rig for literally 2/3rd of the cost of buying without waiting. And this was an optimised build in the first place.
Re:Cloud Storage for $2 per TB per month by vidarh on Saturday March 07, 2020 @01:38AM (#22510181)
They probably could,but they're showing no sign of wanting to compete on cost.

E.g bandwidth costs on AWS are high enough that if you actually serve up lots of data from S3 you can typically afford to rent servers to cache all of it 'in front' of AWS and still save a ton of money.

S3 only gets close to competitive if you never access the data from outside of AWS.

Which gets to the point: If you use an AWS service like S3, you pretty much has to use other AWS services if you want the cost to be even somewhat reasonable in aggregate.

They don't need to compete on cost, because once they get you to buy into one set of services, moving any one set of services off AWS gets more painful and/or costly, and a full migration looks too scary for most people.

S3 will never be priced to undercut anything but big players for that reason. They need to be competitive with Google and Azure, because those guys can offer to offset transitioning costs and generally aggressively target AWS customers.

A small player isn't the same threat even if substantially cheaper.

Re:Cloud Storage for $2 per TB per month by Taek on Friday March 06, 2020 @05:57PM (#22508151)
Sia is a lot more than a low cost storage platform. It's a full reimagining of how the cloud should work with an emphasis on user ownership and control, open access for developers, and ultimately decentralization that allows users to be certain their applications will always work (no more "RSS Reader is shutting down").

This post is intended to address people who do not feel that decentralization can be cost effective at scale.

Re:Cloud Storage for $2 per TB per month by jrochkind1 on Friday March 06, 2020 @06:14PM (#22508272)
Where do I find the introduction what Sia is? I tried clicking around in the headers from OP, but couldn't find it within my very lazy tolerance.
Re:Cloud Storage for $2 per TB per month by Taek on Friday March 06, 2020 @06:29PM (#22508368)
https://blog.sia.tech/skynet-bdf0209d6d34 - this is probably the best thing we have at the moment.

https://support.sia.tech/article/dk91b0eibc-welcome-to-sia - this support article is also a good introduction to the network and why it was built

Re:Cloud Storage for $2 per TB per month by beedrillzzzzz on Friday March 06, 2020 @06:31PM (#22508377)
Website: https://sia.tech/

Also take a look at Skynet, a file sharing protocol built on top of Sia: https://siasky.net/

Re:Cloud Storage for $2 per TB per month by easygenes on Friday March 06, 2020 @07:51PM (#22508866)
I cringe every time a project uses the name "Skynet". First, it's overused. Second, it's literally the name of the AI project that went rogue and tried to kill all the humans in the Terminator movie universe. Not exactly the best association. Just find another name.
Re:Cloud Storage for $2 per TB per month by ethbro on Friday March 06, 2020 @08:45PM (#22509161)
On the other hand, I am filled with positive associations at the name.

Reliability, redundancy, disaster recovery, cost cutting, and absolute focus on execution!

Re:Cloud Storage for $2 per TB per month by Evidlo on Friday March 06, 2020 @08:43PM (#22509151)
See Soylent.
Re:Cloud Storage for $2 per TB per month by ineedasername on Friday March 06, 2020 @09:37PM (#22509344)
What aspect of this infrastructure is user-owned?
Re:Cloud Storage for $2 per TB per month by KarlKemp on Saturday March 07, 2020 @01:36AM (#22510176)
You re certainly reimagining the marketing slang of a few years ago (a decade for the gratuitous dig at Google Reader)
Re:Cloud Storage for $2 per TB per month by risyachka on Saturday March 07, 2020 @02:58AM (#22510461)
Amazon has huge margins. They could sell you the same services for waaaaaay less money. They just won't.
Re:Cloud Storage for $2 per TB per month by jknoepfler on Friday March 06, 2020 @04:48PM (#22507648)
having worked at aws, all I'll say is I think you're wildly over-estimating their agility
Re:Cloud Storage for $2 per TB per month by Hamuko on Friday March 06, 2020 @04:59PM (#22507735)
Care to share any funny stories?
Re:Cloud Storage for $2 per TB per month by scarface74 on Friday March 06, 2020 @05:33PM (#22507976)
Isn’t that what AWS S3 one zone infrequent access is?
Re:Cloud Storage for $2 per TB per month by animalnewbie on Friday March 06, 2020 @10:43PM (#22509599)
> (paraphrased) domain experience means they ae best

As someone who has worked with a couple of market leaders in their respective fields i want to disssaude anyone who would listen of this notion. NO, the market leaders aren't doing things optimally. Some things are downright stupid.