I'm not minimizing the dangers of someone else recording you. I don't think Schmidt was even thinking about that, probably because smartphones weren't so ubiquitous then.

However, you CAN control what you do yourself. Your to-do list can quite easily be on a paper notebook, as can your journal. Another thread here talks about self-hosting your location history -- why TF would you even want that? You can leave your phone at home when you go places where you don't need it. You can talk to people instead of texting them. All these things might be inconvenient, and amusing for some of your friends. But you'll survive it.

Maybe you can't shut off the flow of data about you, but you can at least refrain from adding to it.