I had similar experience in real life. People who were "just joking", when you knew them long enough and closely enough, turned out to be not really joking.