Taste/appearance and safety are not really the same thing. Many places have water that people find unpleasant due to mineral content or other factors, but which is safe to drink.