News for hackers. Stuff that matters.

A comment on Had a call with Reddit to discuss pricing. Bad news for third-party apps. Parent comment

Re:Had a call with Reddit to discuss pricing. Bad news for t... by Karrot_Kream on Thursday June 01, 2023 @02:50AM (#36148248)
Care to show some proof? Create random data, store it somewhere, make sure it's about the size of Reddit. Off-the-cuff let's estimate that read traffic is 100x more than write traffic. Create some load generators that generate this synthetic read and write traffic. The load should follow a Zipf distribution of topics. Make sure it can handle huge traffic surges for events or abuse attacks. Show us your read and write performance. Do a small writeup on the architecture you ended up on, the number and types of servers you allocate, etc. You shouldn't be stopping at an order of magnitude short as scaling challenges change as the magnitude of scale changes.

Unlike Reddit, you'll have the benefit of the hindsight of 2023 instead of managing 20 years of tech debt.

[ Parent | on HN ]
Re:Had a call with Reddit to discuss pricing. Bad news for t... by Attummm on Thursday June 01, 2023 @03:37AM (#36148476)
Instagram have used python and django at scale. They have written about it in their engineering blog[0].

[0]https://instagram-engineering.com/static-analysis-at-scale-a...

[ Parent | on HN ]
Re:Had a call with Reddit to discuss pricing. Bad news for t... by Karrot_Kream on Thursday June 01, 2023 @03:54AM (#36148558)
My question isn't about Python. It's about Reddit being trivial to recreate. I work on an API team at a Big Tech company and, funny enough, a lot of our legacy is in Python and we've scaled it using lots of pretty gross tricks. We may or may not be Instagram (:

The keyword here of course is "at scale". At what scale? Any commenter that believes what was written upthread should create a system and demonstrate that it can scale to Reddit levels.

[ Parent | on HN ]
Re:Had a call with Reddit to discuss pricing. Bad news for t... by raverbashing on Thursday June 01, 2023 @04:56AM (#36148845)
They also think what Reddit does is "only serve large amounts of text" oh where should I start with how wrong this is

I'm sure not even HN "does only that" and even that it does with a lot of help from caching, etc

[ Parent | on HN ]
Re:Had a call with Reddit to discuss pricing. Bad news for t... by RadiozRadioz on Friday June 02, 2023 @07:47PM (#36172249)
python4? Is that coming?

No... not again... I can't.

[ Parent | on HN ]
Re:Had a call with Reddit to discuss pricing. Bad news for t... by Maxion on Thursday June 01, 2023 @04:36AM (#36148768)
> Care to show some proof?

I said large, not huge :P

I'm afraid I don't want to dox myself so I can't post publicly stuff from my employer. And I don't really have time to do what ask and write it up in my free time.

I doubt something the size of reddit would run properly on Python, but I think both mine and the commenter I replied to had the point that most sites on the internet WOULD run fine without all the bloatware and overengineering complexity. Very very few sites have the traffic that reddit does. Most websites belong to the long tail, and for those almost any tech stack would work - so why choose a needlessly complex one?

[ Parent | on HN ]