One big problem is the breadth of problems. Most people don't work with graphs, binary trees, dynamic programming, dozens of other algorithms and data structures you don't use ever daily.