I have seen fully encrypted end to end flows to Twilio. You got it 99% right here.

(There's some nuance around re-encryption proxies and how that is handled.)