Re:37Signals benchmarks uptime vs five leading webapps
by dhh on Tuesday January 31, 2012 @09:44AM
(#3533412)
We configured all the benchmark apps to expect a response. So on Github we go and checkout a repo. On Freshbooks a known invoice. On Assistly the agents index. Etc.
This is "the app is functional" checking. Not just 200 OK.
Re:37Signals benchmarks uptime vs five leading webapps
by sunnysideup on Tuesday January 31, 2012 @11:05AM
(#3533812)
The most reliable measure of true uptime would be transaction monitoring, e. g. simulating a login into all of these web apps. It also catches those issues were the server itself is up but the site does not work for some other reasons (database issue, javascript issue,...).
Or do you know that all your downtime was "total downtime", i. e. server not reachable at all?
Re:37Signals benchmarks uptime vs five leading webapps
by dhh on Tuesday January 31, 2012 @12:26PM
(#3534195)
We do more than just login to the apps. We login and go to an expected spot. So it catches all of that.
This includes total downtime yes.
Re:37Signals benchmarks uptime vs five leading webapps
by themcgruff on Tuesday January 31, 2012 @10:39AM
(#3533662)
That should read we "check a repo". We don't actually do a git checkout.
You can configure it to send POST data and expect a particular response, but there's no way of telling (other than "yep, that's what we're doing") whether someone's uptime stats are based on that sort of check.