If someone in a position to fully establish TCP connections with spoofed IPs wanted to ruin something, I'd think they'd find something a lot more interesting to do...