I agree - he didn't seem offended to me. As evidence, I remembered yesterday that he actually followed up with a really great comment that I think a lot of folks missed. I'm paraphrasing, but it was something like: "Everyone likes controversial questions and controversial answers, but we don't necessarily learn a lot from them."

It seemed really awkward, and judging from the stare he gave you just before he walked off the stage, I would say he got a little offended.