> Even if you write a purely stateless function, it would still be useful to write a unit test to check for correctness.

Indeed. Tests are a good idea in, say, Haskell, too.