I agree the clock puts extra pressure that can make one unable to focus on the task, but it's important to know your time limit.

Consider making the clock like on http://www.sudokuslam.com/ - with an icon right next to it to show or hide it.