With my first two children, they took it at room temperature. Third was born in the winter and tap water was considerably colder and he wouldn't take it.

I would heat an exact amount of water for a specific time in the microwave to get a specific temperature. I started reducing the time in the microwave by one second a day and he never noticed.