Some places do "blind" reference checks, where they contact people you've worked with themselves (through Linkedin or similar.) The idea being that the references you provide are likely to be more positive than representative.