From what I know the Common Travel Area with Ireland would almost surely not be effected by a Brexit. In fact, it predates the countries' EU membership by quite a while.