The problem is? google provides better email service, for free[1], than most pay providers. I am /exactly/ the sort who would run a for-pay email service; I wrote my first sendmail .mc before I was old enough to drink, (and that was back when sendmail was still a thing) and I've been maintaining mailservers longer than that. Also, I have a reasonable reputation for transparency.
But I don't think I could compete with Google. I mean, sure, I could get you a much more private service, but for what people expect to pay, I just couldn't do as good of a job of actually maintaining the mailservers as google does. Hell, even if I could charge 1998 rates, like $5/box/month (which I can't) I don't think I could do a better job of that than google.
If you really want the full privacy benefits of having private email (e.g. being able to know something is /really deleted/ when you delete it,) you have to run your own mail server. Doing this well is a fair spot of work, probably more than $5/day worth of work (I mean, if you are compensated well enough that a latte is worth $5 more than a drip coffee with milk made at home. It is a non-zero amount of work, and you do have some sort of 'emergency' work every couple of years; something that is broken that is causing mail to bounce. Personally, I rate 'emergency' work as more expensive than the kind I can do on my own schedule.)
[1]I mean, in exchange for whatever monetary value they can extract from running their automated advertising tools against your data.
The gmail web interface has become really annoying of late. I don't think it's an impossible task to do better than them by any means.
Google exposes the mail through IMAP, no? why don't you use your own mail client with the google backend?
I've written support software for and modified open-source pop3 and IMAP software, and I've gotten partway through writing my own SMTP server, but I never even /considered/ writing a client interface for mail. If I'm providing mail service, I will provide you mail service, and give you smtp and IMAP (encrypted, of course) interfaces to that mail service. Heck, I might support an open-source imap to web interface, too, but the way I see it? running the mailserver and running the mail client are two very different things. If you primarily choose your mail provider based on the provided web interface, you are probably not going to be a good customer for me, because I consider the mail client to be outside of my domain as a SysAdmin. Also, I come from an era where web-gateways to IMAP were considered some kind of cruel joke.
I'm not saying that interfaces are unimportant, but it's a very different product than just managing mail servers. I'm good at managing mail servers. I have a difficult time coming up with someone who would be less qualified to write a custom web interface. (I mean, unless the current open-source imap-to-web interfaces are good enough; I can manage open-source software just fine; I'm just not a UI kind of person.)
Personally, I wouldn't expect the sorts of companies that are best at running mail servers to also be the best at writing mail clients. That, and I wouldn't want to give up control of my client to other people, because a lot of what makes up a user interface is personal preference. That, and there's no real advantage to having the same people run the server and the client; IMAP is well-standardized.
As far as I can tell, paying for your email does not get you any real increase in privacy. Rackspace staff can read your email just as easily as Google staff can read Gmail (it's strictly against company policy in both places, but still technically possible). If the FBI issues a subpoena for your email, both Rackspace and Google will be legally compelled to give it up.
When we don't pay for email, we are at the mercy of free email providers. They can terminate our account for any reason, without no appeal whatsoever. It has happened before.
Email is fundamental, it is the one foundation on top of which we do things on the internet. Forgot password, bookings, registration on a new site - every single one of them is via email. And most of us happily trust Google (or Microsoft etc) with our email, without paying a penny. I'm not saying these companies aren't great, or willfully do something bad with our data (they won't - if anything, gmail is really nice, except for UI) - It is just that they have no incentive to help us when we get in trouble (account getting hacked, for example). After all, they are a business, not charity.
Email is just one example. It surprises me that people wouldn't pay for important things (even when they are cheap) but would happily pay for overpriced coffees, popcorns in theaters (huge rip off) etc. Same with those who buy only "branded" items, even though many times the non-branded items are nearly as good and are cheaper.
However, there is a difference from an organizational pressure perspective: with gmail, I'm not really Google's customer. With hosting, I am the host provider's customer. As a result, the nature of the business relationship is more clearly defined and they have less incentive to play fast-and-loose with the "rules". (Excluding legal mandates, unethical employees, etc. which are an equal exposure either way)
It did take me time, but I have realized that emails and email addresses are NOT going away anytime soon, might as well have something permanent.
If you've told everyone your email address is [email protected], it's almost impossible for you to move for whatever reason. The switching costs are actually very high. If it's [email protected], you can move your email provider at will, and you're unlikely to ever be forced to pay more than $10 per year, which is pocket money for most folk.
So yes, if you don't mind having someone elses company name in your main identity on the web, that's fine (along with all the portability tie in problems and privacy). On the other hand if you want [email protected] then you'll probably be shelling a little money out.
And fastmail provides other services too, that people might be more used to paying for, e.g. static webhosting with webdav support for upload, custom dns control. Contacts accessible through ldap, distribution lists, sms, detailed control over login including OTPs etc.
I've switched recently and do not regret it. It gives me a lot of the flexibility I had years back when I ran my own mail server, and none of the massive pain.
Perhaps the answer is that people have gotten used to everything being "free" on the internet. May be they think that the cable (or internet) bill is more than enough, and they are entitled to get everything for free online, including movies etc?