http://www.ornl.gov/ornl/news/news-releases/2015/ornl-led-te...
Yes I know I'm ignoring things like biofilm buildup, particulate settling, etc. I'm mainly trying to illustrate the "basic work" required to get drinking water from sea water using the latest technology. Most existing reverse osmosis membranes are only capable of 1 litre per square centimetre per megapascal per DAY. That's not even a remotely practical rate without mechanically applied pressures, and since we're now dealing with hydraulic pressures... a lot more engineering and maintenance.
I am still wondering about the efficiency in terms of filtering toxins. Water molecules are smaller than most other molecules but I am not sure if some toxins would still be able to get through the holes in the graphene? Things like heavy metals
And yes, the cost of that would be huge, not just in cities. In the UK the decision the victorians made to not have separate sewage and rain water drainage systems still has a knock-on today and costs a vast amount in water treatment, but the cost of separating rain runoff and sewage is still seen as prohibitive.
edit:
However, on a small local-scale grey water systems can do a lot of good, both for re-use but also rain water capture and re-use would help with flood prevention. If houses captured rainwater for use for lawn watering and other appropriate uses, this is something that could be done without great expense.
I'm not arguing against the idea, especially as it is typically implemented in the UK where a house will generally only have about 500 litres of storage, but scaling it up and making it a requirement could cause some interesting problems.
For example, a house would fitted with a storage tank for shower water, which is then used for flushing the toilet, or even watering a yard. The toilet water is sent to city sewer system.
In arid third word countries people have low tech outdoor arrangements like pit toilets.
While I'm fairly confident that we can eliminate most live pathogenic organisms from sewage with enough work, excreted toxins, hormones, and undigested pharmaceuticals are another matter. Diluting those through a watershed serves a real purpose that sewage treatment facilities are not up to replicating.