Privacy in the sense that you can train better AI systems when you have more data. Apple has many self-imposed and restrictive policies around collecting data and what type of data they collect, so they inherently have a disadvantage when it comes to building better AI systems.

Ok, but all of that data is on your phone and devices. You could theoretically train there.

Most of your data (ex. search history) is not reliably stored on your phone, and even if it was it would be much better to train on the server side instead of making your phone do all of the work. Also, they probably train using data from everyone, not just one user.

OK, but apple can store your data encrypted on their servers or on your phone and still train data models... Privacy can be preserved.