Fair enough! We take data security and privacy very seriously and have built many safeguards to prevent even us from accessing the raw data in the cloud. At some point in the future we hope to launch local inference models too!

Respectfully, talk is cheap. Every company says they take security and privacy seriously even after their database has been breached and their customers' plaintext passwords and credit card details have become public information.

If you were actually serious about prioritizing privacy above securing an ongoing service relationship you would ship local inference as the default and only (possibly later) offer a cloud service as an optional add-on for those who want/need it.

This is the gate for me. I've put a deposit down, but need to see how this is going to be run locally before I'll actually pay for them. There is absolutely zero chance of me sending everything that goes to my "keyboard" to my system via a cloud, no matter how many assurances are provided. Maybe I can see that being necessary on mobile (maybe?) but on a laptop it is a full-stop "no" - I have lots of horsepower, this needs to work 100% locally. I might be OK with doing a cloud-assisted "training" interval, but once complete, there should be no requirement for network connectivity for production use.

Same for me. I put the deposit down but will pull out if it doesn’t come with local inference. Makes no sense for my thoughts to go to the internet. I’m ok with having slightly poor local inference quality compared to the cloud one. And one can encrypt the local inference to prevent reverse engineering the weights etc.

The commercial reality I’m sure they’re dealing with is that the percentage of users who care enough to deal with everything required for local inference is nowhere close to large enough to make it into an initial launch.