There's always a story behind every codebase. Taking the new team member through the codebase at a high level, telling the story and explaining how everything fits together and is deployed is a time well spent.

It helps me connect with them, develops empathy, understanding and aids my form of communication with them.

The how is explained above. Why you should is "because humans".