We did in fact interbreed. Some modern human populations are as much as 5% neanderthal in their DNA. That much gene content to me suggest that this population was absorbed; a one off breeding here or there would not persist to 5% of the genetic material millions of years ago today unless hybridization was occurring frequently.