Bentham didn't want the people in the outside structure to ever know whether they were being observed or not at any particular time, this was a key part of the way it was supposed to work, so the people in the tower cannot be seen by the people in the cells.