News for hackers. Stuff that matters.
Re:Why’s that company so big? I could do that in a weekend by liquidpele on Wednesday September 27, 2023 @06:38PM (#37682379)
Not just scaling it… scaling it in a way that doesn’t immediately bankrupt you. Bit of a chicken and egg problem with advertisers.
Re:Why’s that company so big? I could do that in a weekend by MrLeap on Thursday September 28, 2023 @01:13AM (#37685479)
This is one of those _things_ that I suspect causes many greybeards to grimace.

What's a tweet? We can haggle this up and down so cut me some slack. 200 bytes? 50 bytes? gzipped -90%, 5 bytes.

Holy shit what absurd amount of traffic could a 1gb fiber connection handle?

oh huh 200 million tweets a second. That's silly. How wrong could I be? -- then you run down the numbers and you realize that no matter how wrong you are, a twitter-clone-for-most-people oughta be cheap. The network effects and fuzzy human reasons are their moat, nothing else.

One of those fuzzy human reasons is how amazon EC2 eats your ass. Just gobbles it from stem to stern.

Re:Why’s that company so big? I could do that in a weekend by tehjoker on Thursday September 28, 2023 @01:32AM (#37685597)
They have pictures and video now. You also have to sort them in real time, check for blocked, mutes, etc, and each tweet is amplified to followers so one tweet requires e.g. 700 copies or 1M copies depending on follower count.

The text part is basically solved at this point, but not quite that easy. I hear dealing with blocks is one of the slow parts.

Re:Why’s that company so big? I could do that in a weekend by MrLeap on Thursday September 28, 2023 @01:52AM (#37685755)
HN doesn't host pictures or video. I come here well before I do twitter, reddit, facebook, youtube or anywhere else on the internet commons.

I hazard there's a verdant, halcyon prairie between the two zones. The common zone of maximum extraction, and the hypothetical 200$-a-month-operating-costs text only twitter that can service 5% of the entire planet.

Re:Why’s that company so big? I could do that in a weekend by tehjoker on Sunday October 01, 2023 @02:32AM (#37723311)
Perhaps, but you'd be missing a lot of good memes
Re:Why’s that company so big? I could do that in a weekend by nemothekid on Thursday September 28, 2023 @02:29AM (#37686030)
When I look at Twitter, I think first about the business model, and then I think about the app. I think, today, it's a lot easier to build Twitter the user facing app, even at scale.

Where I see your engineering headcount blow up is in moderation, legal and advertising; which I think everyone skips over when doing their mental math. Campaign management, targeting, reporting, and optimization on such a large corpus of data is where I struggle to see even a team of 5 building that in a couple of weekends.

Re:Why’s that company so big? I could do that in a weekend by sgarland on Thursday September 28, 2023 @09:04AM (#37689063)
> 200 million/sec

OK, but you aren’t just pushing raw ASCII across the wire, you’re getting those results out of a database.

For a weekend clone, someone will probably just use an RDBMS (a very reasonable choice). I’ll be generous and say they can retrieve a given tweet in sub-msec time, say 10 usec. Suddenly, you can only send 100,000 tweets/sec, ignoring all other overhead (which of course you can’t).

I’m sure there is unoptimized code and some unnecessary bloat, but fundamentally there are limits on data retrieval that are very, very hard to get close to.