Actually, the Labour vote went up under Milliband. It was a quirk of the voting system that caused Labour to lose seats.