Yes establishing a state religion is a power retained by the states. The states were independent countries before federation and so they retain a great deal of power.

In practice this is not something that we have to worry about here in Australia. The high court has rule in a few case an implied right to freedom of religion in the constitution in much the same way they have done so for freedom of speech - although freedom of speech seems to be under far more attack of late here.