The thing that makes it an obvious joke is that it's a simple reversal of a previous statement. That is a very common pattern for jokes.