I'm not sure if it neccesarily that the first iPhone was special in an of itself, but that the shift to mobile was special, and was largely enabled by the iPhone. Subsequent models aren't tied to a once-in-a-generation shift in technology, and so they feel more like iterative improvements.
I think the slides in the keynote were actually on-point for this, there've been multiple innovations (multi-touch, high-DPI screens, Touch ID, their shift to in-house processors, computational photography), and it's really the aggregate that's lead to a great device. But break it down and it is an iterative, evolutionary process. That's why so many people often seem disappointed after every keynote!
That said, maybe the original iPhone really was a bit special :-)