For someone who dislikes smalltalk, the ideal is for their conversational partner to maintain the discussion until a topic that interests them is brought up. Between two people, this is perhaps insolvent, but with a larger group, some of whom may already know each other, it is perfectly feasible to wait until you have something to say to speak.