Re:Ask HN: What do you use to monitor your websites?
by EGF on Sunday November 01, 2009 @05:03PM
(#915645)
Pingdom - use it on quite a number of projects and they keep adding more data checks around the world making it even better to triangulate back to where and why people are having problems.
Re:Ask HN: What do you use to monitor your websites?
by alecco on Sunday November 01, 2009 @09:47PM
(#915985)
If you pre-pay 3 months or a year a good web hosting costs $4.5-7/month, with cronjobs, and plenty of space where you can store regular offsite backups.
An almost trivial one-liner with curl can do this kind of service.
Re:Ask HN: What do you use to monitor your websites?
by alecco on Monday November 02, 2009 @03:50PM
(#917883)
No, I don't mean to run your site on a web hosting. The thread topic was a monitoring service that pings a website and alerts you charging a ridiculous amount, in my opinion, for an extremely simple service to deploy SEPARATELY on a web hosting plan.
Re:Ask HN: What do you use to monitor your websites?
by moe on Monday November 02, 2009 @08:29PM
(#918359)
Well, if that amount seems ridiculous to you then you're looking at the wrong figure. Have you considered what it costs to have an engineer sit down and write a proper monitoring and alerting system? Even a small one, i.e. the proverbial curl-loop?
That is the figure you should be looking at because even if you assume only a single day of work you can already buy many months of pingdom service for the same money.
Moreover even the smallest monitoring utility takes quite a bit more effort than a single day once you take SMS alerts with backoff (you don't want to spam, right?), scheduled downtimes and overall babysitting into account. Been there, done that.
So, look at the big picture and those $10 bucks suddenly become a no-brainer.
Re:Ask HN: What do you use to monitor your websites?
by alecco on Monday November 02, 2009 @03:53PM
(#917889)
Exactly. Setting up a cronjob to monitor and test your web application (be it Cloud, VPS, or dedicated) should be something everybody here can do with eyes closed or at least ask. Paying a pinger service sounds idiotic unless I'm missing something from that service. I'm surprised it even exists.
Re:Ask HN: What do you use to monitor your websites?
by thesethings on Sunday November 01, 2009 @11:53PM
(#916175)
I use cloudkick.com, which is a hosted service. It's the most accurate hosted monitoring I've ever used. Less false positives than any other hosted service I've used, and the fastest (accurate) notifications of true issues.
The catch?
You have to be using one of the hosts they cover (currently EC2, EC2 Europe, Rackspace, Slicehost.). They will probably add a bunch more soon, as they are organizers of the libcloud project, which aims to build interfaces for all popular providers. Code checked in so far covers Linode, vps.net, vCloud Express, for example. (http://libcloud.org/)
It's easy to install because you don't have to install any agents on your system. You just plug in your (provider) key at the friendly, easy Cloudkick dashboard, et voila. All the accuracy of agented monitoring, none of the mess/packages/server set-up.
(Lots of hosted monitoring services act like "agentless" monitoring, which means not that accurate or fast to notice things.)
Also, it's free. (Though it seems like they may have premium services one day.)
Re:Ask HN: What do you use to monitor your websites?
by moomerman on Sunday November 01, 2009 @06:09PM
(#915736)
I'm working on http://nimbu.net/ at the moment that does what you're looking for. I've just added twitter alerts too if you use twitter. If you've got anything specific you would want to monitor then please let me know.
Re:Ask HN: What do you use to monitor your websites?
by andrewtj on Sunday November 01, 2009 @07:10PM
(#915807)
I just signed up for your service. The interface is quick, clean and intuitive - frankly, it's a relief to use it. I also have to give you props for having an SMS setup that works internationally. A handy addition for me would be DNS monitoring.
Re:Ask HN: What do you use to monitor your websites?
by techiferous on Sunday November 01, 2009 @06:27PM
(#915759)
I've got lots of little sites that I'd like to monitor but that aren't that important and aren't making money. So I'm looking for a tool that has a free option but when one of my apps grows into a serious product I can start paying for more services.
For the free service, I'm looking for something that would notify me by email and SMS if the site is down or slow (within about an hour). So far it looks like http://aremysitesup.com/premium/ can do this. Pingdom is way too expensive for my needs right now.
I would love to support a fellow Hacker News reader. Does your app fit my needs?
Re:Ask HN: What do you use to monitor your websites?
by moomerman on Sunday November 01, 2009 @06:32PM
(#915764)
Yeah, nimbu.net does do what you're asking for and it will always be free for one site. You will get notifications by email and/or SMS and/or twitter within minutes of your site going down. The SMS option won't always be free, but you can send via Twitter and then get Twitter to SMS you for a free option.
Edit: I just re-read about having lots of little sites. I will consider a reduced-functionality (eg. as you say within the hour notification) but allowing more free sites as an option.
Re:Ask HN: What do you use to monitor your websites?
by jackowayed on Sunday November 01, 2009 @06:47PM
(#915781)
"always free for 1 site" seems like a bad call. unless you have a ridiculous number of sites, is it really that much work to make a different account for each site, either with different emails or using a gmail/google apps email and putting a different +whatever in your address? I would guess that your rate of paying customers will be pretty low.
Re:Ask HN: What do you use to monitor your websites?
by moomerman on Sunday November 01, 2009 @07:28PM
(#915824)
You make a good point and I've thought about that a lot but competitive sites offer free accounts so it would be hard for me not to have a similar option.
Re:Ask HN: What do you use to monitor your websites?
by loupgarou21 on Monday November 02, 2009 @10:49AM
(#916986)
You could do something like zoneedit and just have some stern warning about dropping your accounts or charging you for back usage if you get caught circumventing the free limit by opening multiple accounts.
Re:Ask HN: What do you use to monitor your websites?
by techiferous on Sunday November 01, 2009 @07:09PM
(#915806)
aremysitesup.com is free for five sites, not one, so they are offering me a better solution for my particular problem. The next step up, $35/year, is also low enough to not drive me away. I also see that nimbu.net says, "At the moment nimbu is free to use with a limit of 3 websites." and I have more than 3 I want to monitor right now.
As you can see, you have a lot of sites competing with you (which means you have a market!). Now you need to distinguish yourself.
I'm having trouble finding a service that does the following:
* Offers me a free service that's suitable for sites that aren't that critical.
* Once I need a higher level of service, offers me a way to gradually turn up the service and payment.
Maybe I'm expecting too much out of a free service.
EDIT: I realize what my expectations are now. I think Google has spoiled me. Here's what I expect (and I think the web monitoring service that can offer this solution will likely win):
* Monitor an unlimited number of websites at a frequency of not more than 60 minutes. Will send an SMS and an email if the site is unavailable or too slow. (Maybe there is a cap on the number of SMS messages per month.)
Re:Ask HN: What do you use to monitor your websites?
by moomerman on Sunday November 01, 2009 @07:25PM
(#915821)
Thanks for the detailed response. It is useful to hear real-life requirements and I'll bear this in mind when thinking about pricing options. I must admit though the number of options on site24x7 is a bit off-putting to me, I was thinking about much easier 'packages'
Re:Ask HN: What do you use to monitor your websites?
by stuntgoat on Sunday November 01, 2009 @08:39PM
(#915891)
Why not write a script that checks the site from a cron job on a different server. You can have it send an email or text via twitter. Cron is a simple service. And if you can write a script that emails you or your phone, you only need to place it on a very reliable server or 2.
I wrote a script, run via cron, that checked a ticket web page every 30 minutes for concert ticket availability. If the text changed, it implied that the tickets were available; the script sent an email to my phone, a text message, telling me call for tickets. ( Ratatat was the band )
Re:Ask HN: What do you use to monitor your websites?
by joevandyk on Sunday November 01, 2009 @10:59PM
(#916089)
pingdom checks your site from multiple servers all over the world. they provide great uptime and response time graphs. lot more than a one line script can do via a cronjob.
Re:Ask HN: What do you use to monitor your websites?
by DenisM on Sunday November 01, 2009 @05:48PM
(#915700)
Does anyone know of a monitor that validates entire pages? I want to make sure that my site was not defaced so I would like to compute and compare hash values for a set of files.
Re:Ask HN: What do you use to monitor your websites?
by cracell on Sunday November 01, 2009 @05:59PM
(#915721)
Hmm. So I've been writing an uptime monitor and this is an interesting idea. How would you update the hash and how would you handle dynamic content? If the service offered this feature via API seems like a lot of work on the user end.
Re:Ask HN: What do you use to monitor your websites?
by DenisM on Sunday November 01, 2009 @07:02PM
(#915798)
The site is AJAX so all files (HTML, JS) are static. I am perfectly fine copy-pasting the hashes manually each time I roll out the new version, like this file:
The dynamic part of the site comes from a database, but there is no logic in it - only code, and thus possibility to inject malicious sctript, odd behavior or offensive visual through hacking the web site is vastly reduced by verifying hashes and alerting me about any changes.
Re:Ask HN: What do you use to monitor your websites?
by matthewking on Sunday November 01, 2009 @04:52PM
(#915640)
I use pingdom, it runs on remote servers where locally run systems will fail if your datacenter loses its internet connection etc. Can't fault it but ignore the response times, I think the pingdom servers are just slow ;)
Re:Ask HN: What do you use to monitor your websites?
by truebosko on Sunday November 01, 2009 @09:18PM
(#915944)
I use http://sucuri.net/ for a very simple up/down, content changed notification system. It tracks those as well as DNS, HTTP Certs and a few more. It's also free :)
Re:Ask HN: What do you use to monitor your websites?
by techiferous on Sunday November 01, 2009 @10:43PM
(#916058)
Wow, that seems like a great service for completely free! I assume you've had a good experience with them? How long have you used their services and how many web sites do you monitor?
Re:Ask HN: What do you use to monitor your websites?
by truebosko on Monday November 02, 2009 @11:38AM
(#917117)
I've been using them for about 6 months? I only monitor three websites that all together get about 2k uniques a day so nothing major. Never had any problems and you can customize some of the notices down to the line, which is nice.
Re:Ask HN: What do you use to monitor your websites?
by barmstrong on Sunday November 01, 2009 @09:09PM
(#915925)
I use monit on my linux boxes.
It requires some setup but the big advantage of this is that it can not only tell you when your site is down, but sometimes ACTUALLY FIX IT by restarting nginx or whatever you need it to do.
This is something a monitoring service can't do since they don't have access to your box. Of course it's not going to be able to fix all situations that could cause downtime, but if it hits a scenario you anticipated it will.
Re:Ask HN: What do you use to monitor your websites?
by andrewtj on Sunday November 01, 2009 @10:06PM
(#916002)
Don't use it to the exclusion of external tools though. monit doesn't help if the server has no connectivity or no power. On a similar tangent, configuring a mutual restart policy (eg: if cron fails monit restarts it and vice versa) is also a good idea.
Re:Ask HN: What do you use to monitor your websites?
by moe on Monday November 02, 2009 @08:20PM
(#918343)
Actually automatic countermeasures are almost always a bad idea. Don't do it.
If a service crashes repeatedly then fix the service, don't deploy bandaids. Those bandaids tend to pile up and god help you when that pile comes crashing down...
Re:Ask HN: What do you use to monitor your websites?
by rsanders on Wednesday November 04, 2009 @04:25AM
(#921370)
Wormly is great not just for showing whether something's up, but what's been going on with it. I use it like a hosted Cacti for my host and MySQL performance measurement. Very nice.
An almost trivial one-liner with curl can do this kind of service.
That is the figure you should be looking at because even if you assume only a single day of work you can already buy many months of pingdom service for the same money.
Moreover even the smallest monitoring utility takes quite a bit more effort than a single day once you take SMS alerts with backoff (you don't want to spam, right?), scheduled downtimes and overall babysitting into account. Been there, done that.
So, look at the big picture and those $10 bucks suddenly become a no-brainer.
The catch?
You have to be using one of the hosts they cover (currently EC2, EC2 Europe, Rackspace, Slicehost.). They will probably add a bunch more soon, as they are organizers of the libcloud project, which aims to build interfaces for all popular providers. Code checked in so far covers Linode, vps.net, vCloud Express, for example. (http://libcloud.org/)
It's easy to install because you don't have to install any agents on your system. You just plug in your (provider) key at the friendly, easy Cloudkick dashboard, et voila. All the accuracy of agented monitoring, none of the mess/packages/server set-up.
(Lots of hosted monitoring services act like "agentless" monitoring, which means not that accurate or fast to notice things.)
Also, it's free. (Though it seems like they may have premium services one day.)
For the free service, I'm looking for something that would notify me by email and SMS if the site is down or slow (within about an hour). So far it looks like http://aremysitesup.com/premium/ can do this. Pingdom is way too expensive for my needs right now.
I would love to support a fellow Hacker News reader. Does your app fit my needs?
Edit: I just re-read about having lots of little sites. I will consider a reduced-functionality (eg. as you say within the hour notification) but allowing more free sites as an option.
As you can see, you have a lot of sites competing with you (which means you have a market!). Now you need to distinguish yourself.
I'm having trouble finding a service that does the following:
* Offers me a free service that's suitable for sites that aren't that critical.
* Once I need a higher level of service, offers me a way to gradually turn up the service and payment.
Maybe I'm expecting too much out of a free service.
EDIT: I realize what my expectations are now. I think Google has spoiled me. Here's what I expect (and I think the web monitoring service that can offer this solution will likely win):
* Monitor an unlimited number of websites at a frequency of not more than 60 minutes. Will send an SMS and an email if the site is unavailable or too slow. (Maybe there is a cap on the number of SMS messages per month.)
* Offer very gradual price increases for increased service (gradual like this: http://site24x7.com/site24x7-pricing.html)
It sends you an email when a site goes down. The free version pings every 20 minutes or so.
Monit after a tip here, great little program.
I wrote a script, run via cron, that checked a ticket web page every 30 minutes for concert ticket availability. If the text changed, it implied that the tickets were available; the script sent an email to my phone, a text message, telling me call for tickets. ( Ratatat was the band )
I'm not familiar with that service btw, just remembered seeing that here a few days ago. I use nagios both at home and at work.
It requires some setup but the big advantage of this is that it can not only tell you when your site is down, but sometimes ACTUALLY FIX IT by restarting nginx or whatever you need it to do.
This is something a monitoring service can't do since they don't have access to your box. Of course it's not going to be able to fix all situations that could cause downtime, but if it hits a scenario you anticipated it will.
If a service crashes repeatedly then fix the service, don't deploy bandaids. Those bandaids tend to pile up and god help you when that pile comes crashing down...
Not only it monitors if your site is down, but also if it has been blacklisted, defaced, etc.
Also your site is lite on details - makes a lot of claims about protecting this or that without any explanation on how this protection is achieved.
How do you validate integrity of the content? Do you compute and compare hashes of all files?
Also, you should list the world-wide locations you are checking from.