In a column-by-column situation if you're in a window seat you would have to wait for the two columns before to deboard anyway. The problem would be if you are in a middle seat and the person next to you is waiting for his family in the line right before yours, but that's kind of a special case anyway.