Add in the fact that good TVs are basically always made by the companies who are the Very Worst at software (Samsung most prominently), and you have a recipe for digital heartburn.
No thanks. Dumb TVs forever.
Also, to respond to another comment, there's no correlation between a TV being "smart" and achieving a simple A/V setup with a single remote and a minimum of hassles. Unless you mean a negative correlation. It's very simple to achieve single-remote nirvana with a dumb TV. Plus you're not stuck with a dumb company's remote and software; you can pick your own, because a dumb TV will work with anything and not get in your way.
Singled out for especially thorough beatings are those TV makers who put actual physical buttons on their remotes for websites that might be gone next week. Seriously? No.
Dumb TVs forever.
I don't think the problem is with Smart TVs, I think it's just the current execution of the idea.