News for hackers. Stuff that matters.
Re:Amazon CodeGuru – Preview by seibelj on Tuesday December 03, 2019 @07:15PM (#21698350)
Amazon has made scalable, performant, high-availability systems constructable by a 10 person team that serves millions or even billions of people. Before AWS it took thousands of people and billions in capital investment to do so.

Sure, google and Microsoft and IBM joined the party, but AWS was first and remains the best holistically. This is their moment of domination, and eventually something will knock them down, but they have made so many companies so nimble and powerful in ways that were impossible before. Go Amazon.

Re:Amazon CodeGuru – Preview by mythz on Tuesday December 03, 2019 @08:31PM (#21698816)
>Before AWS it took thousands of people and billions in capital investment to do so.

WhatsApp Stats (2014):

- 450 million active users, and reached that number faster than any other company in history.

- 50 billion messages every day across seven platforms (inbound + outbound)

- 32 engineers, one developer supports 14 million active users

- $60 million investment from Sequoia Capital

Which they managed their own FreeBSD servers hosted on SoftLayer.

[1] http://highscalability.com/blog/2014/2/26/the-whatsapp-archi...

YouTube (2008):

"YouTube grew incredibly fast, to over 100 million video views per day, with only a handful of people responsible for scaling the site"

- 2 sysadmins, 2 scalability software architects

- 2 feature developers, 2 network engineers, 1 DBA

"They went to a colocation arrangement. Now they can customize everything and negotiate their own contracts."

"Sequoia invested a total of $11.5 million in two separate rounds and was the only venture firm to invest in the company." [3]

[2] http://highscalability.com/youtube-architecture

[3] https://www.nytimes.com/2006/10/09/business/09cnd-deal.html

Re:Amazon CodeGuru – Preview by kbenson on Tuesday December 03, 2019 @08:46PM (#21698895)
I'm pretty sure GP is mistaking valuation for capital. Serving half a billion or more people probably nets you a billion dollar valuation or more these days, but it in no way requires a billion dollars to provide that service in the vast majority of cases.

There is a sweet spot where cloud is good and provides some benefit but, once you're serving hundreds of millions of people and have double-digit millions in investment, you can probably do significantly better cost-wise rolling your own servers. Worst case, you just throw your own hypervisor management system on them and have most of the same features you got from a cloud service. If you're smart, you can probably architect it so you have on-demand overflow capacity from a cloud provider in case there's a spike you can't account for, which is the best of both worlds.

Re:Amazon CodeGuru – Preview by pard68 on Tuesday December 03, 2019 @11:40PM (#21699628)
This is how we do it. Two on prem datacenters, one colo, and a handful of on-the-ready cloud providers. We serve far fewer users, but we also are getting 20 to 50k per user per year. Needless to say, at the scale we have cloud is out of the question except in catastrophic scenarios.
Re:Amazon CodeGuru – Preview by notatoad on Wednesday December 04, 2019 @12:16AM (#21699788)
Back in the day, reddit was definitely serving a couple million users with like three staff and on-prem servers.

and yeah, they were down all the time, but that didn't seem to matter to their growth.

Re:Amazon CodeGuru – Preview by vidarh on Wednesday December 04, 2019 @05:49AM (#21701154)
I've built high-availability systems that served millions with a <10 person team years before AWS even existed, at a time where our server racks had less combined capacity than my laptop does now, and the dual fridge sized storage array we used had less storage (and IO capacity) than the M.2 drive in my laptop does now.

The part of that solution which was related to making the system scalable was written by two of us, who also did other things (it involved a partionable backend storage service, and a user registration service, that combined to let us migrate users between servers to even out load and partition storage; everything else was stateless).

This idea that AWS is necessary to build to scale with small staff just does not match reality. My years of consulting also showed me that I'd earn more from clients who insisted on AWS - they typically spent far more time and resources on devops (and spent far more on hosting overall).

AWS is convenient, and it's great when you can afford it, but it's expensive and still requires substantial devops effort.

Re:Amazon CodeGuru – Preview by EliRivers on Wednesday December 04, 2019 @05:52AM (#21701169)
Go Amazon.

Indeed. Hopefully, soon they'll stop selling physical items in that online store they have and focus on their strengths, so that other companies, who might be able to do better at selling things that aren't so frequently counterfeit that I no longer buy anything from Amazon, can have a go.

Re:Amazon CodeGuru – Preview by chance_state on Tuesday December 03, 2019 @07:23PM (#21698400)
>Before AWS it took thousands of people and billions in capital investment to do so.

Could you expand on this?

I can't tell if you mean to launch a service/company or if you're talking about some large scale.. thing.. I haven't heard of.

Re:Amazon CodeGuru – Preview by dumbfoundded on Tuesday December 03, 2019 @07:33PM (#21698470)
Instagram comes to mind. 13 employees and $1B acquisition.

Hard to imagine that without AWS.

Re:Amazon CodeGuru – Preview by jakear on Tuesday December 03, 2019 @08:34PM (#21698835)
WhatsApp? Similar story, no AWS.
Re:Amazon CodeGuru – Preview by dumbfoundded on Wednesday December 04, 2019 @03:36AM (#21700573)
Well, WhatsApp was started by industry experts in scaling. If you're making a point about functional programming, I'd tend to agree but from a business perspective I'd look to why Netflix still uses AWS: https://www.quora.com/Why-does-Netflix-still-use-AWS
Re:Amazon CodeGuru – Preview by gurrone on Wednesday December 04, 2019 @08:19AM (#21701876)
Still they place FreeBSD running on prem hardware in the ISP PoPs as a caching layer because it absolutely makes sense. https://papers.freebsd.org/2019/FOSDEM/looney-Netflix_and_Fr...
Re:Amazon CodeGuru – Preview by cupofsludge on Wednesday December 04, 2019 @06:19AM (#21701268)
I think people tend to forget how often WhatsApp experienced outages in the early days.
Re:Amazon CodeGuru – Preview by jakear on Friday December 06, 2019 @09:49PM (#21728141)
This actually speaks volumes. Yes, people forget. Yes, it’s possible to suffer severe growing pains and still get acquired for $$$$. No, you don’t need to start with everything-AWS to ensure 99.9-whatever% uptime. People forget.
Re:Amazon CodeGuru – Preview by nine_k on Tuesday December 03, 2019 @08:35PM (#21698840)
An $1B acquisition may have nothing to do with any colossal infrastructure. Was it indeed colossal?
Re:Amazon CodeGuru – Preview by dumbfoundded on Wednesday December 04, 2019 @03:37AM (#21700584)
I don't know what you'd consider colossal but the migration doesn't sound fun: https://www.wired.com/2014/06/facebook-instagram/
Re:Amazon CodeGuru – Preview by vidarh on Wednesday December 04, 2019 @05:58AM (#21701184)
Why? Sharding and caching blob storage and activity feeds for Instagram type sites is among the easiest category of sites to scale.
Re:Amazon CodeGuru – Preview by sitkack on Wednesday December 04, 2019 @02:59AM (#21700405)
Not it didn't. This is hyperbole.
Re:Amazon CodeGuru – Preview by randomidiot666 on Wednesday December 04, 2019 @03:22AM (#21700506)
Moore's Law made it possible, not AWS.