If you're taken away for too long, you may miss your flight. I'd hope that the airline would put you on the next one, despite them not having to do so.