If the goal is just to avoid using Google, you don't necessarily need to sync contacts and calendars over USB.

You can use CalDav and CardDav with a non-Google online service like Fastmail.