The K-T mass extinction was very rapid, possibly as short as few thousand years and most models/data point to substantially less than a million years. Which is kind of compatible with an impact event.

Other mass extinctions with different potential causes took longer.