In practice functional languages have ways to mark certain code as having side effects for I/O and the like, which stops the badness from escaping to the rest of the program.

You're right in thinking that software with no side effects at all wouldn't be very useful.