News for hackers. Stuff that matters.
Re:Show HN: Snips is a AI Voice Assistant platform 100% on-d... by oulipo on Thursday June 15, 2017 @08:10AM (#14559624)
I'm a co-founder of Snips, we are building a private-by-design Voice Assistant platform which allows companies and makers to build a smart assistant 100% on-device.

Why do we do this? We want assistants of the future to respect user privacy, and not stream your voice or your most important questions to servers that you do not control.

With Snips, 100% of what we do runs on the device (the platform ships for Raspberry Pi, more platforms are available for entreprise customers, [email protected])

We are using state-of-the-art deep-learning Automated Speech Recognition and Natural Language Understanding to allow makers to plug a voice assistant in their device in 5 minutes.

We are actually benchmarked our NLP and are outperforming most of the commercially available NLU providers: https://medium.com/snips-ai/benchmarking-natural-language-un...

Re:Show HN: Snips is a AI Voice Assistant platform 100% on-d... by taneq on Thursday June 15, 2017 @10:00AM (#14560409)
This is awesome. Every other assistant AI type product seems to be designed primarily as a pretext for invading its users' privacy. Thanks for building something that might be both useful and trustworthy at the same time!
Re:Show HN: Snips is a AI Voice Assistant platform 100% on-d... by oulipo on Thursday June 15, 2017 @11:28AM (#14561283)
Thanks! And we take privacy very seriously, as should most companies now because the people will ask for this in the future.

No reason Google should know what you ask your Voice Assistant to buy, or to remind you of!

Re:Show HN: Snips is a AI Voice Assistant platform 100% on-d... by _jal on Thursday June 15, 2017 @11:53AM (#14561525)
Ditto.

I still have no idea if I'm actually interested in voice UI, but I'd actually experiment with this one, unlike any existing implementation.

Edit - any other existing implementation.

Re:Show HN: Snips is a AI Voice Assistant platform 100% on-d... by natch on Thursday June 15, 2017 @02:44PM (#14563190)
You should take a look at what Apple is doing if you think that. Especially the developments announced last week. Going forward I would expect to see a vast number of products on that platform both from Apple, and from third party developers, that are doing on-device and privacy-focused implementations of AI applications.
Re:Show HN: Snips is a AI Voice Assistant platform 100% on-d... by taneq on Thursday June 15, 2017 @08:59PM (#14565799)
Do you have a good link for technical info? I found the Wired article but all that says is:

> The HomePod uses local recognition to hear the Hey Siri command, and encrypts all your communication.

That's great as far as it goes (at least it's not streaming all audio) but it doesn't rule out the rest of the command from being sent upstream, and encryption just stops third parties from intercepting it - if I don't want the vendor listening in either, it doesn't really solve my problem.

Happy to be proven wrong by some more in-depth info from Apple though!

Re:Show HN: Snips is a AI Voice Assistant platform 100% on-d... by CaptSpify on Thursday June 15, 2017 @05:24PM (#14564499)
Without source code that seems like all smoke and mirrors to me.

I'd love it if they released it, and I'd start buying their stuff immediately. But until they put their money where there mouth is... meh

Re:Show HN: Snips is a AI Voice Assistant platform 100% on-d... by natch on Thursday June 15, 2017 @05:36PM (#14564593)
No need to be snide about it. Of course they aren't going to open source the entire OS. Just like Google hasn't open sourced all of Android. They always hold something back.

And you're commenting on an article where the maintainer has said that open source is "coming in the future."

In the meantime:

https://opensource.apple.com

https://github.com/apple

http://llvm.org

https://swift.org

https://developer.apple.com/opensource/

I think it's safe to say they are betting the company on this, and putting plenty of money into it.

And far from being smoke and mirrors vaporware, this is hardware and software that you can hold in your hand and use and rely on, and millions of people do, every day.

Re:Show HN: Snips is a AI Voice Assistant platform 100% on-d... by CaptSpify on Thursday June 15, 2017 @06:07PM (#14564856)
I'm not sure how my comment is "snide". It's just a fact: I don't trust them.

And I don't see how Google is relevant to the conversation. They don't release source, so I'm not really interested in their products either. Just because one company is does things in a way I don't like doesn't mean I have to accept it when others do it that way.

"coming in the future" is nice, but I've heard that speech before, and I'm not holding my breath. If they are betting the company on this, then great! I'll put a lot of money into their products. But until they do, meh, I'm not interested.

And by smoke and mirrors I don't mean vapor-ware, I mean distracting from the real issues, and hiding their flaws instead of fixing them.

Re:Show HN: Snips is a AI Voice Assistant platform 100% on-d... by natch on Thursday June 15, 2017 @07:03PM (#14565203)
Well, you are making assumptions from ignorance.

You don't have to hold your breath. I gave you the links. The open source is already there. Breathe.

And you seriously think Apple is not fixing flaws?

Watch their WWDC sessions. They have fixed tons of flaws.

Your hate is showing through. Maybe set aside your feelings once in a while and look at the facts.

Re:Show HN: Snips is a AI Voice Assistant platform 100% on-d... by CaptSpify on Thursday June 15, 2017 @10:29PM (#14566214)
I really don't think I understand what you mean. Those links are some open source stuff that they've done. Great. That's not the OS, nor the apps. I want them to open source the OS and their apps.

I'm sure they are fixing security flaws, but they are still not addressing the underlying issue. I like what they say their philosophy is, but until they open source all their stuff, I have no reason to trust them.

I definitely hate them, because I really want a company like them to succeed. But they refuse to put their money where their mouth is. I'd invite you to point me to any facts that I've missed, but I don't see where I've missed any.

Re:Show HN: Snips is a AI Voice Assistant platform 100% on-d... by natch on Friday June 16, 2017 @02:07AM (#14566972)
Let me know when you've watched their WWDC talks from this year on privacy and security. Especially privacy.

You could do previous years too and those would be complementary, not redundant, but that's quite a time commitment and a lot to ask. Just this year's would be a really great start. Then I'd love to hear what you think after that.

Yeah they won't be completely open source any time soon, that's a nice dream, lol. But imho you should open your mind to learning about what they are doing now, before being so negative and down on them.

Re:Show HN: Snips is a AI Voice Assistant platform 100% on-d... by CaptSpify on Friday June 16, 2017 @12:23PM (#14570259)
> Let me know when you've watched their WWDC talks from this year on privacy and security. Especially privacy.

Nope, not going to. Frankly it's a waste of my time because I'm not going to buy their product. They can say nice things on a stage all they want, but until they open source it, then I really don't care. If they open-source it, then I would buy their products in a heartbeat.

You say it's a nice dream, I say it's reality. I have a laptop/desktop system that works great and is FOSS. I don't see how phones or any other computerized device is any different. None of it matters until they put their money where there mouth is. I'm only being negative towards them because they refuse to fully commit to what they preach. I find nothing wrong with that, and frankly, I don't get how other people don't have a problem with that.

Re:Show HN: Snips is a AI Voice Assistant platform 100% on-d... by natch on Saturday June 17, 2017 @02:01PM (#14576924)
They were not saying just nice things on stage, contrary to your little imagined scenario. They were saying stuff a lot of developers didn't want to hear.

Stuff like stop tracking, limit tracking, don't capture so much data, protect privacy this way, that way, do machine learning on device in such a way that data never makes it to any cloud, use storage techniques that keep the keys away from anyone but the user including Apple, etc.

A lot of developers buy into protecting privacy but to many developers they were not saying nice things on stage, as you unthinkingly imagine.

If you don't get things, and lack understanding, the solution is to seek knowledge. I suggested one good way to do that. Your ignorance is on you, not on them.

Re:Show HN: Snips is a AI Voice Assistant platform 100% on-d... by CaptSpify on Saturday June 17, 2017 @04:44PM (#14577657)
I think your missing my point: I don't care what they say. I care what they do. Actions speak louder than words. If they are encouraging privacy, cool. I can respect that. But they aren't doing privacy.

Until they do that, why would I look into them? I choose ignorance in a lot of things that waste my time. Looking into a company that won't put their money where their mouth is would also be a waste of that time.

Re:Show HN: Snips is a AI Voice Assistant platform 100% on-d... by natch on Saturday June 17, 2017 @06:42PM (#14578061)
Meh. Do your homework.
Re:Show HN: Snips is a AI Voice Assistant platform 100% on-d... by CaptSpify on Saturday June 17, 2017 @08:56PM (#14578447)
What homework have I not done? What fact am I missing? I have all of the information needed to make an accurate judgment.

You've yet to give me any answer to that question, and I'd invite you to point me to anything that I have stated that is incorrect.

Re:Show HN: Snips is a AI Voice Assistant platform 100% on-d... by oulipo on Thursday June 15, 2017 @02:58PM (#14563336)
At Snips we are serious about privacy and happy to see so many people taking it as seriously as us!
Re:Show HN: Snips is a AI Voice Assistant platform 100% on-d... by roel_v on Thursday June 15, 2017 @11:32AM (#14561333)
Do you do any pre-processing on the audio input to filter out background noise? I notice that in the demo video, you're in a quiet room.

I can run PocketSphinx on Raspberry Pi fine, and the recognition is fine too - as long as there isn't too much background noise. When I say 'computer open curtains', for example, it open my curtains through my HA system; but the motors in the curtains make some noise, so I can't say 'stop' halfway through because it just won't pick it up. Another part of the problem is that audio chunks are fed to PocketSphinx by recognizing end of sentence through silence in the input; so when the curtains are still going, it doesn't recognize that the command has stopped and the audio should be passed into PocketSphinx.

So, how does Snips deal with this?

Re:Show HN: Snips is a AI Voice Assistant platform 100% on-d... by oulipo on Thursday June 15, 2017 @11:45AM (#14561461)
We use state-of-the-art deep-learning models that are very robust to noise (much more robust than what you get with GMM using Sphinx) and we train the model on data containing noise.

This should be paired with a good microphone using microarray to locate the speech very precisely!

Our hotword solution is also robust to noise and could be used to detect a word over noise

Re:Show HN: Snips is a AI Voice Assistant platform 100% on-d... by jd20 on Thursday June 15, 2017 @01:25PM (#14562396)
Are there any off-the-shelf array microphones you recommend, for pairing with Snips on the Pi?
Re:Show HN: Snips is a AI Voice Assistant platform 100% on-d... by mfester on Thursday June 15, 2017 @02:28PM (#14563037)
We've been experimenting with three setups so far: the Matrix Creator, the ReSpeaker and the Conexant. We will soon publish an in-depth benchmark, as well as (highly needed!) tutorials on how to set them up so that they work optimally as audio capture devices on Raspberry.
Re:Show HN: Snips is a AI Voice Assistant platform 100% on-d... by Trisk3lion on Wednesday June 28, 2017 @07:49AM (#14653299)
Looking forward to it! Maybe using the VoiceHat as well?
Re:Show HN: Snips is a AI Voice Assistant platform 100% on-d... by putnam on Thursday June 15, 2017 @02:22PM (#14562978)
Coming from a signal processing background, this is interesting. Would your company be interested in doing a newsletter with https://enterprisedeeplearning.github.io?

Edit: softened the sales pitch

Re:Show HN: Snips is a AI Voice Assistant platform 100% on-d... by oulipo on Thursday June 15, 2017 @02:57PM (#14563331)
Sure, you can send us some info at [email protected]
Re:Show HN: Snips is a AI Voice Assistant platform 100% on-d... by roel_v on Thursday June 15, 2017 @01:08PM (#14562230)
Great, looking forward to trying this.
Re:Show HN: Snips is a AI Voice Assistant platform 100% on-d... by Eridrus on Thursday June 15, 2017 @11:15AM (#14561137)
So, why does your marketing material compare api.ai trained on 70 examples to Snips trained on 2000 examples?
Re:Show HN: Snips is a AI Voice Assistant platform 100% on-d... by oulipo on Thursday June 15, 2017 @11:46AM (#14561464)
Hi!

We are comparing what you get by using an alternative service like api.ai (which you need to start by feeding manually) with what you can do with our solution.

Manually feeding 70 queries per intent already takes a good deal of energy and imagination, so we thought it was representative of a good effort from a user. This is why Snips proposes to its users to automatically to use generative methods to create high-quality datasets (over 2000 queries per intent).

All hypotheses are clarified in our blog post on performances which I encourage you to read! https://medium.com/@alicecoucke/benchmarking-natural-languag...

We even post all the underlying data and results on GitHub so people will be able to verify our claims: https://github.com/snipsco/nlu-benchmark/tree/master/2017-06...

Re:Show HN: Snips is a AI Voice Assistant platform 100% on-d... by Eridrus on Thursday June 15, 2017 @12:16PM (#14561725)
> Manually feeding 70 queries per intent already takes a good deal of energy and imagination

Only if you have to manually make them up. If you have access to the query stream (which I imagine api.ai etc give you since they're online platforms), it's quite quick and easy.

I can definitely appreciate integrating things together to make things easy, but this is a pretty biased comparison IMO.

It's great that you've made the data available, but the headline metric that most people will see seems misleading.

Re:Show HN: Snips is a AI Voice Assistant platform 100% on-d... by oulipo on Thursday June 15, 2017 @12:20PM (#14561778)
API.ai and companies which keep user data on their servers are putting user privacy at a risk, and they don't really match the performance we can have when we do datascience carefully
Re:Show HN: Snips is a AI Voice Assistant platform 100% on-d... by vmarsy on Friday June 16, 2017 @12:27AM (#14566672)
In the links you provide, you compare the F1 score for snips with other major competitors on 70 queries.

Then you show the F1 score for snips on 2000 queries. Obviously you see improvements and that's good. What I don't understand is why don't you show the F1 score for the other competitors on 2000 queries? If you're able to generate 2000 input from the original 70, what prevents you from feeding those to the other NLP engines? Do they all get a 93% F1 score ?

Re:Show HN: Snips is a AI Voice Assistant platform 100% on-d... by skykooler on Thursday June 15, 2017 @09:48AM (#14560296)
Is this a homebrew speech recognition engine, or are you using something existing like sphinx/julius/kaldi?
Re:Show HN: Snips is a AI Voice Assistant platform 100% on-d... by jd20 on Thursday June 15, 2017 @01:27PM (#14562415)
Based on their website, it would seem to indicate TensorFlow is being used.
Re:Show HN: Snips is a AI Voice Assistant platform 100% on-d... by woodson on Thursday June 15, 2017 @02:04PM (#14562791)
Tensorflow is only mentioned for NLU, no mention of it for ASR.
Re:Show HN: Snips is a AI Voice Assistant platform 100% on-d... by mtw on Thursday June 15, 2017 @09:14AM (#14560045)
It would be great to have a hands-on tutorial on how a developer or user could set this up to control speakers or a magic mirror like this https://github.com/HannahMitt/HomeMirror :)
Re:Show HN: Snips is a AI Voice Assistant platform 100% on-d... by mfester on Thursday June 15, 2017 @02:38PM (#14563135)
Yes absolutely. In fact we created a dedicated Labs team within Snips (check out http://labs.snips.ai) with that in mind: to create DIY hacks, proof-of-concepts, benchmarks and related material for the community. We are just getting started, and have published our first post on building a connected speaker: https://medium.com/snips-ai/how-to-build-a-voice-controlled-.... Stay tuned, many more are coming over the next months.
Re:Show HN: Snips is a AI Voice Assistant platform 100% on-d... by azinman2 on Thursday June 15, 2017 @01:36PM (#14562485)
Are you going to generalize your hotword detection like snowball? Or allow me to mix and match... e.g. use snowball to wake up then use you for voice recognition / intent matching?

One of the reasons I want to build my own is fix issues I see in all the commercial ones, namely the lack of conversation back and forth & being so fixed to a single wake word. For example, when my timer is firing, I don't want to say 'alexa, turn off the timer.' I just want to say 'ok', 'stop', 'cancel timer,' etc.

Re:Show HN: Snips is a AI Voice Assistant platform 100% on-d... by oulipo on Thursday June 15, 2017 @02:56PM (#14563314)
We will add a way for users to record hotwords with their own voice and learn a detector on-device. You can subscribe to our newsletter to be informed when new features will come!
Re:Show HN: Snips is a AI Voice Assistant platform 100% on-d... by paulsutter on Thursday June 15, 2017 @09:32AM (#14560171)
Will you publish the model model and Tensorflow source? Or is this just a binary install?
Re:Show HN: Snips is a AI Voice Assistant platform 100% on-d... by oulipo on Thursday June 15, 2017 @11:30AM (#14561306)
Thanks! We are committed to open-source and transparency and we want to open-source most of the major inference component of our platform! We started doing some open-source that you can look at on Github now

https://medium.com/snips-ai

Re:Show HN: Snips is a AI Voice Assistant platform 100% on-d... by paulsutter on Thursday June 15, 2017 @04:39PM (#14564155)
I found your github[1] which includes platform documentation[2] and various API code but I didn't see any trained weights or Tensorflow models. Some users might want to extend the model and open source could be a great way to get momentum behind your platform.

[1] https://github.com/snipsco/

[2] https://github.com/snipsco/snips-platform-documentation

Re:Show HN: Snips is a AI Voice Assistant platform 100% on-d... by 52-6F-62 on Thursday June 15, 2017 @11:39AM (#14561386)
Are you going to be releasing a Snips app for mobile, or are you planning on leaving this up to enterprise groups to develop themselves independently?

Also do you have any hardware vendors on board who want to include Snips natively?

Re:Show HN: Snips is a AI Voice Assistant platform 100% on-d... by oulipo on Thursday June 15, 2017 @11:48AM (#14561480)
Thanks! We will release a mobile companion app that people can use to connect to their devices and we are working with partners to embed our platform on native boards!

Subscribe to our newsletter on https://snips.ai to stay tuned and see our blog for more datascience and DIY content!

Re:Show HN: Snips is a AI Voice Assistant platform 100% on-d... by 52-6F-62 on Thursday June 15, 2017 @12:04PM (#14561619)
Great news, thanks.

Already signed up!

edit: Any plans to see Snips natively in end-user devices?

Re:Show HN: Snips is a AI Voice Assistant platform 100% on-d... by oulipo on Thursday June 15, 2017 @12:55PM (#14562117)
Yes! we are talking to some smart speaker companies and other builders!
Re:Show HN: Snips is a AI Voice Assistant platform 100% on-d... by 52-6F-62 on Thursday June 15, 2017 @01:15PM (#14562310)
Even better news, thanks again
Re:Show HN: Snips is a AI Voice Assistant platform 100% on-d... by problems on Thursday June 15, 2017 @10:05AM (#14560472)
Thank you! You made the first voice assistant platform I'll actually give a serious shot to. I hope your attitude towards user privacy catches on with your competition.
Re:Show HN: Snips is a AI Voice Assistant platform 100% on-d... by IshKebab on Thursday June 15, 2017 @08:15AM (#14559657)
That is a great benchmark. Can you give a rough idea of how your NLU works? Or some keywords to search?
Re:Show HN: Snips is a AI Voice Assistant platform 100% on-d... by oulipo on Thursday June 15, 2017 @08:45AM (#14559834)
We are using state-of-the-art deep-learning with Tensorflow for most of our processing
Re:Show HN: Snips is a AI Voice Assistant platform 100% on-d... by IshKebab on Thursday June 15, 2017 @12:25PM (#14561838)
Yeah but I meant which algorithms are you using?
Re:Show HN: Snips is a AI Voice Assistant platform 100% on-d... by tezza on Thursday June 15, 2017 @02:38PM (#14563132)
1) how many hotwords can you have ?

my application would need only around 20 distinct words

2) can they be non dictionary hotwords ?

say "fruznumble" ?

3) how do headset mics work. a lot of the hotness is mic arrays for roomscale commands, but how does it work with older style mics ?

Re:Show HN: Snips is a AI Voice Assistant platform 100% on-d... by oulipo on Thursday June 15, 2017 @02:55PM (#14563302)
For now there is a hotword shipped in the platform, but if you are an entreprise customer we can train a hotword for you.

The hotword detector uses deep-learning and requires quite a bit of data to be robust to noise and to various accents.

We are working on a version which would allow more people to build hotword robustly and fast

Re:Show HN: Snips is a AI Voice Assistant platform 100% on-d... by oulipo on Thursday June 15, 2017 @03:08PM (#14563450)
We will be pushing an update of the platform on Friday which solves a small bug where the ASR is taking a bit of time to start listening after the hotword is detected

The next version is smooth!

Re:Show HN: Snips is a AI Voice Assistant platform 100% on-d... by mattcoles on Thursday June 15, 2017 @09:51AM (#14560320)
Is there potential for a MIPS build? Would be excited to try this out on an Onion Omega.
Re:Show HN: Snips is a AI Voice Assistant platform 100% on-d... by oulipo on Thursday June 15, 2017 @10:35AM (#14560757)
We are working on expanding the platforms, stay tuned!
Re:Show HN: Snips is a AI Voice Assistant platform 100% on-d... by JustFinishedBSG on Thursday June 15, 2017 @09:48AM (#14560298)
Do you just magically happen to take CIFRE Thésards in NLP/Machine Learning?
Re:Show HN: Snips is a AI Voice Assistant platform 100% on-d... by oulipo on Thursday June 15, 2017 @10:35AM (#14560748)
Sure you can apply to https://snips.ai/jobs !
Re:Show HN: Snips is a AI Voice Assistant platform 100% on-d... by paul7986 on Thursday June 15, 2017 @02:07PM (#14562818)
Is there a api for web?
Re:Show HN: Snips is a AI Voice Assistant platform 100% on-d... by thro1237 on Thursday June 15, 2017 @09:46AM (#14560275)
what kind of microphone do you recommend for pi?
Re:Show HN: Snips is a AI Voice Assistant platform 100% on-d... by oulipo on Thursday June 15, 2017 @12:21PM (#14561795)
Many microphones can work because our ASR is robust, ideally you want a microarray with noise cancelling
Re:Show HN: Snips is a AI Voice Assistant platform 100% on-d... by mediocrejoker on Thursday June 15, 2017 @01:10PM (#14562265)
Could you link to a "microarray" microphone that's available for purchase?
Re:Show HN: Snips is a AI Voice Assistant platform 100% on-d... by mfester on Thursday June 15, 2017 @02:47PM (#14563224)
Here is what we've been playing with: - Matrix Creator: https://creator.matrix.one/ - ReSpeaker: https://www.seeedstudio.com/s/respeaker.html - Conexant: http://conexant.com (quite expensive, but powerful) We are also waiting for the Matrix Voice, still on Indiegogo, due late Summer: https://www.indiegogo.com/projects/matrix-voice-open-source-.... As mentioned earlier, we will soon release a benchmark of the various mic array solutions, as well as tutorials for setting them up.
Re:Show HN: Snips is a AI Voice Assistant platform 100% on-d... by stedaniels on Friday June 16, 2017 @04:18AM (#14567394)
The Matrix Voice seems the most affordable... for makers that is :-)