People almost always make such points as part of an agenda against of the sides. If you insist you didn't mean it way, ok, I believe you (though that would be highly unusual)—in that case, though, your comment would have needed to come with enough information to make that clear. Otherwise the default interpretation kicks in anyway.