News for hackers. Stuff that matters.
Re:“just put Twitter in the cloud” we tried that- $300M monthly by mikkergp on Friday November 18, 2022 @08:48PM (#33665847)
Often people will say “AWS is so much bigger than us, they have to accommodate us / what could we know that they don’t” is that AWS is still building for the median customer (+/-). It doesn’t make financial sense to optimize for the extremes and extremes can be extreme (per the tweet thread). If you’re a reasonably technical company there’s a good chance something about your main workloads will challenge AWS.
Re:“just put Twitter in the cloud” we tried that- $300M monthly by PaulsWallet on Friday November 18, 2022 @09:11PM (#33666008)
I wouldn't call my company reasonably technical and we frequently hit barriers in AWS. Twitter has no chance on AWS.
Re:“just put Twitter in the cloud” we tried that- $300M monthly by yrgulation on Friday November 18, 2022 @09:20PM (#33666079)
deployments alone are a challenge. there are so many race conditions it’s sometimes impossible to do it reliably.
Re:“just put Twitter in the cloud” we tried that- $300M monthly by Ptchd on Friday November 18, 2022 @08:59PM (#33665928)
The cloud is for peace of mind (in some ways)... not for saving money
Re:“just put Twitter in the cloud” we tried that- $300M monthly by yrgulation on Friday November 18, 2022 @09:19PM (#33666074)
“in the cloud” - is it a desktop app now? or is the world cloud synonymous with aws, and aws only?
Re:“just put Twitter in the cloud” we tried that- $300M monthly by andrewstuart on Friday November 18, 2022 @09:29PM (#33666137)
I can’t understand how cloud means “simple and cheap” to so many people and companies. In fact it’s the absolute opposite.

There’s tons of much, much more powerful and cheap servers you can get online than those of the major clouds, often with little or no traffic fees.

Most companies are too lazy to even investigate the choices.

Re:“just put Twitter in the cloud” we tried that- $300M monthly by gsatic on Friday November 18, 2022 @10:09PM (#33666452)
More than laziness, it's too complex a problem for most decision makers. Environment is ever changing and extremely competitive. Most people don't handle such problems well and few get the training or have the support. It's pretty much like crypto. Most people are sold shit they have no capacity to understand. So the story writes itself.

These are info asymmetry problems and society and business hasn't been dealing with them at such scales for too long. So solutions are a work in progress.

Re:“just put Twitter in the cloud” we tried that- $300M monthly by papito on Saturday November 19, 2022 @05:00AM (#33668752)
The cloud is great when you are starting out, but at scale you are going to hemorrhage money. This is why it's dangerous to tie yourself to all those cloud "toys" and then rapidly expand.

If I just want to have my own little home page, a micro EC2 instance will do just fine - I don't want to go to a colocation for that.

Once you are at scale, you need to get out of the cloud. I agree with DHH on this.

https://world.hey.com/dhh/why-we-re-leaving-the-cloud-654b47...

Re:“just put Twitter in the cloud” we tried that- $300M monthly by the8bit on Friday November 18, 2022 @09:45PM (#33666256)
m6.12xl are 48 vCPU systems. 25 million cores is a hilariously huge amount of compute to use to run a site of twitter size, which I guess does point to how much tech debt they have ignored over time.
Re:“just put Twitter in the cloud” we tried that- $300M monthly by crazygringo on Friday November 18, 2022 @10:28PM (#33666603)
By "twitter size" are you implying it's... small?

Twitter is the 4th most visited site in the world.

https://en.wikipedia.org/wiki/List_of_most_visited_websites

Re:“just put Twitter in the cloud” we tried that- $300M monthly by steve1977 on Saturday November 19, 2022 @04:03AM (#33668441)
But it’s basically just simple data moving, it should be rather trivial in terms of compute power needed.
Re:“just put Twitter in the cloud” we tried that- $300M monthly by mazurnification on Saturday November 19, 2022 @12:10PM (#33672059)
There is nothing simple in data moving. Problem is that it can be abstracted away so you do not have to worry about it. Out of sight out of mind. Example - majority of the CPU area is devoted to data moving problem (cache, branch prediction, out of order execution, register renaming). The same is happening on other levels of the stack (OS, network and so on).
Re:“just put Twitter in the cloud” we tried that- $300M monthly by throwaway2729 on Friday November 18, 2022 @10:08PM (#33666445)
They should have probably written it in Assembly.
Re:“just put Twitter in the cloud” we tried that- $300M monthly by lolbserious on Friday November 18, 2022 @11:13PM (#33666854)
It sounds high for sure.

But they do serve videos, which possibly they have to transcode or otherwise process on import (?) They probably also have some filters for pictures to remove porn and stuff like that.

This can amount to serious CPU if you have millions of users uploading that stuff daily.

A pure text-based Twitter would be much smaller.

Re:“just put Twitter in the cloud” we tried that- $300M monthly by steve1977 on Saturday November 19, 2022 @04:09AM (#33668469)
There would be better EC2 instances (or AWS services) for that though.
Re:“just put Twitter in the cloud” we tried that- $300M monthly by karmakaze on Friday November 18, 2022 @09:56PM (#33666335)
Developing for the cloud makes sense when you're developing features as fast as you can leveraging cloud services to make it all easier. When you have a relatively stable feature set and scaling massively it's better to use private datacenters.
Re:“just put Twitter in the cloud” we tried that- $300M monthly by funstuff007 on Friday November 18, 2022 @10:18PM (#33666540)
Snapchat pays Google cloud $400MM a year. Using these cost metrics, are Twitter's compute needs 9X those of Snapchat? maybe so. seems reasonable to me. And then perhaps, this person is saying that cloud (Google or otherwise) is not the way to go for Snapchat

https://www.vox.com/2017/3/1/14661126/snap-snapchat-ipo-spen...

Re:“just put Twitter in the cloud” we tried that- $300M monthly by funstuff007 on Friday November 18, 2022 @10:19PM (#33666544)
I guess this makes FTX's $250K a month spend on AWS downright thrifty.
Re:“just put Twitter in the cloud” we tried that- $300M monthly by nunez on Saturday November 19, 2022 @02:12AM (#33667827)
there are banks that also spend millions per month on AWS
Re:“just put Twitter in the cloud” we tried that- $300M monthly by funstuff007 on Saturday November 19, 2022 @08:44AM (#33669970)
probably the same banks to say no to vendors who cannot provide on-prem solutions. but, but, but it's ok if you're AWS.
Re:“just put Twitter in the cloud” we tried that- $300M monthly by nunez on Wednesday November 23, 2022 @03:02PM (#33723830)
or if you say "on-prem is on the roadmap"
Re:“just put Twitter in the cloud” we tried that- $300M monthly by trh0awayman on Saturday November 19, 2022 @02:19AM (#33667879)
Isn't this sorta what Oxide Computer is trying to solve? Where you can have your cloud and eat it too?
Re:“just put Twitter in the cloud” we tried that- $300M monthly by larksimian on Saturday November 19, 2022 @08:50AM (#33670020)
300m/month to deliver text, some photos and a bit of video to (admittedly tons of) people sounds insane.

Then again based on the architecture sketch Elon posted https://mobile.twitter.com/elonmusk/status/15938990295318036... most of the compute is being used by ... the feed recommender AI crap that works awfully anyway? Insanely bad job programming this product.

Re:“just put Twitter in the cloud” we tried that- $300M monthly by tim333 on Saturday November 19, 2022 @09:00AM (#33670097)
>500,000 m6gd.12xlarge systems

And I think HN still runs on one server? 500,000 for twitter seems a tad inefficient

Re:“just put Twitter in the cloud” we tried that- $300M monthly by aaomidi on Saturday November 19, 2022 @11:15AM (#33671434)
Did you compare HN with Twitter?
Re:“just put Twitter in the cloud” we tried that- $300M monthly by jscheel on Saturday November 19, 2022 @12:24PM (#33672247)
lol, right?
Re:“just put Twitter in the cloud” we tried that- $300M monthly by tim333 on Saturday November 19, 2022 @01:54PM (#33673342)
I guess kinda. Googling HN has about 300k daily active users, Twitter about 250m so 800x approx.
Re:“just put Twitter in the cloud” we tried that- $300M monthly by FartyMcFarter on Saturday November 19, 2022 @03:21PM (#33674243)
Do you really think the number of users tells the whole story? The websites are very different.