It's been forever since I read this, but IIRC Consider Phlebas was more of just some alien action novel that didn't get much into the Culture. I see a lot of people recommending to start with Player of Games instead of Consider Phlebas to get more of a feel of what the series is like.