http://youtu.be/arsAs9pGrBk?t=52s
I don't know for sure that the tigger word is processed locally on SmartTVs too, but it's likely because Samsung said: 'voice data is provided to a third party during a requested voice command search', so you have to request it's happening probably with the trigger word. And technically it would not make too much sense to constantly stream audio from every SmartTV because the trigger word recognition is a simple enough task to do it locally and also the continuous stream would consume lot of bandwidth for the users and probably for the servers too.
But it's still very concerning that we have more and more devices with microphones and internet connections and in the case of SmartTVs proprietary OS with questionable security.
The funny thing is that ever since Xbox one I have gotten so used to voice commands for playing/pausing/muting videos that I ended up building one on raspberry pi to control the tv, lights and other devices.
Apparently it's an option in the US (but not the default?).
Considering it wasn't even available in Germany for quite a while, I wouldn't be surprised if there are legal requirements surrounding this feature.
I've turned it off for everything aside from my Xbox One which I find myself trusting for some reason.