Technically, on-device processing is clearly the way forward (it's interesting how Apple is currently pioneering the field in a way).

The pessimist in me already sees how three letter agencies worldwide will welcome this change in order to push down their selectors to the device as well. Recording only the one percent of potentially relevant conversations will make backdoors exponentially easier to hide in the background traffic as well as being much lighter to process.