You still need to blur objects that should not be in focus or you’re going to get mixed depth information.

EX: http://www.photographyblogger.net/wp-content/uploads/2011/06... Now picture an infocus immage behind the blurry background pen's.