What does it take to run a web app with 5K

Re:What does it take to run a web app with 5K – 10K users? by jsherer on Friday January 09, 2015 @11:10AM (#8862788)

I run Minimal Reader [1] (which has about 5k users) and I can say that running a web app like this takes a lot of time and energy keeping everything running smoothly.

My service has a lot of moving parts, all of which are distributed among a couple dozen different servers. Keeping the technical infrastructure running smoothly requires a lot of data visualization of server stats, database stats, web request stats, worker stats, user stats, etc. I have everything piped into a nice dashboard so we can see if there is anything odd happening at a glance. When things break (and they will) you need to know where to look first.

Having 5k users also requires time to help them with support issues. Users generate a lot of bug reports, questions, and suggestions. To keep paying users happy, I offer a 1-day response time on support issues, which requires me to spend quite a bit of time sending emails.

Then, of course, if you want to grow the app, you need to spend time marketing it. We could talk for hours about this.

The list goes on and on. Feel free to shoot me an email (email in my profile) if you want to talk specifics about anything.

[1]: https://minimalreader.com/

[ Parent | on HN ]

Re:What does it take to run a web app with 5K – 10K users? by martin_ on Friday January 09, 2015 @11:27AM (#8862874)

StackExchange does 590million monthly views with around half that [1] and it includes redundancy. Do you think 24 could be overkill?

[1] http://stackexchange.com/performance#

[ Parent | on HN ]

Re:What does it take to run a web app with 5K – 10K users? by jsherer on Friday January 09, 2015 @11:31AM (#8862899)

Not overkill as servers are not equal and different apps require different infrastructure. The bulk of my servers are small worker servers that go out and fetch feeds. Parallel downloads, high network throughput, low CPU/memory.

[ Parent | on HN ]

Re:What does it take to run a web app with 5K – 10K users? by inchforward on Friday January 09, 2015 @11:16AM (#8862824)

24 servers? Can you elaborate on your architecture a little more? What tools do you use to help you manage them?

[ Parent | on HN ]

Re:What does it take to run a web app with 5K – 10K users? by jsherer on Friday January 09, 2015 @11:35AM (#8862924)

Most of the servers are workers which fetch feeds. Parallel downloads across a number of low-level commodity servers. Additionally, there's a master and slave Postgres database, a small Cassandra cluster, 2 redis boxes, an elasticsearch cluster, front-end servers, caching servers, etc. Shoot me an email if you want to talk in more detail.

[ Parent | on HN ]

Re:What does it take to run a web app with 5K – 10K users? by NYCounihan on Friday January 09, 2015 @12:30PM (#8863201)

and one server to rule them all...

[ Parent | on HN ]

Re:What does it take to run a web app with 5K – 10K users? by ashark on Friday January 09, 2015 @11:22AM (#8862852)

One server to serve an RSS reader to the 5k users, 23 others to host 23 different stats and monitoring applications to make sure that one server is working OK?

[ Parent | on HN ]

Re:What does it take to run a web app with 5K – 10K users? by ShinyCyril on Friday January 09, 2015 @11:32AM (#8862909)

I can't speak for him, but the RSS reader I am working on at the moment is similarly split into multiple parts:

* Crawler - retrieves RSS feeds and parses articles

* Database server

* Analyser - performs semantic analysis and various other statistical processing on posts

* Propagator - pushes new posts to everyone's feed

* Cacher - serves a cached copy of the user's feed

* Web server

Based on loads I would just add more nodes depending on what was needed.

[ Parent | on HN ]

Re:What does it take to run a web app with 5K – 10K users? by jsherer on Friday January 09, 2015 @11:35AM (#8862929)

Pretty close :)

[ Parent | on HN ]

Re:What does it take to run a web app with 5K – 10K users? by thebiglebrewski on Friday January 09, 2015 @11:35AM (#8862931)

One server (machine), 23 servers (waiters) to cater to that one servers' (machine) every needs?

[ Parent | on HN ]

Re:What does it take to run a web app with 5K – 10K users? by jsherer on Friday January 09, 2015 @11:46AM (#8862987)

Closer to 50/50. 50% of the servers do actual tedious work. 50% cater to users' needs.

[ Parent | on HN ]

Re:What does it take to run a web app with 5K – 10K users? by ShinyCyril on Friday January 09, 2015 @11:26AM (#8862870)

This looks like a really slick app - congratulations! I'm actually working on an RSS reader at the moment with a few similar philosophies (respecting privacy, lightweight design etc.). There's a lot of competition in the RSS reader space since the sad demise of Google Reader - how did you market the site and get your first users?

[ Parent | on HN ]

Re:What does it take to run a web app with 5K – 10K users? by jsherer on Friday January 09, 2015 @11:43AM (#8862972)

Thanks. Selling a web service to consumers in a market where the previous leader was free is tough. But, it's doable.

Shoot me an email (email in profile) if you want to talk specifics.

[ Parent | on HN ]

Re:What does it take to run a web app with 5K – 10K users? by syllogism on Friday January 09, 2015 @01:24PM (#8863501)

Hey that "queue for free account" thing is brilliant. Good presentation too!

[ Parent | on HN ]

Re:What does it take to run a web app with 5K – 10K users? by Abundnce10 on Friday January 09, 2015 @01:38PM (#8863581)

I agree, I haven't seen the "Wait in line for a free account" before. Can you describe this feature in more detail? For example, how long does a user have to wait, does it allow in more users as the size of the queue grows, etc.?

[ Parent | on HN ]

Re:What does it take to run a web app with 5K – 10K users? by jsherer on Friday January 09, 2015 @01:54PM (#8863680)

It is usually set to a fixed number of users per hour with a minimum wait time. Keeps the server happy when I get HN'd/Reddit'd/etc. (Does anybody get Slashdotted anymore?)

[ Parent | on HN ]

Re:What does it take to run a web app with 5K – 10K users? by jsherer on Friday January 09, 2015 @01:52PM (#8863668)

Thanks. I've signed up for a couple of services that do that. It seems to work out even though some people get a little annoyed that they have to wait.

[ Parent | on HN ]

Re:What does it take to run a web app with 5K – 10K users? by bw00d on Saturday January 10, 2015 @12:40AM (#8866044)

Thanks, I will.

[ Parent | on HN ]