You get used to the local water, it's safe in most any urban area in SEA.

Refrigerated bottled water is cheap though, only 12 cents, but I know many locals who perceive drinking out of plastic bottles to be a bigger health risk than drinking tap water.