I've used bad paper straws that didn't last through a single glass but any I've used in the last year has been much more robust. A better question than paper or plastic would be to ask why your iced tea needed a straw at all.