you don't need differentiability you just need a learning rule. there are learning algorithms that don't use gradient ascent.