If you don't mind a bit of work (weekly rinsing) and discarding part of the water, I'd recommend a reverse osmosis filter. They're reasonably cheap and beat the crap out of all the alternatives for non-professional users. You'll essentially have to add back some salts after the filtration process to turn it into something that won't demineralise you.