End to end encryption usually refers to users being the ends and the service provider being the transport. So while it is sitting on apples servers it is kind of in transport but delayed until you make the request to get it back.