The problem seems to be latency. TV aren't meant to be interactive as much as PC monitors are. Especially at a high resolution like this, you will notice a lag between the time you perform an action and the time the TV renders it.
Reports are that lag time on the seiki is pretty small because it has the most bare-bones of image processing. Crummy video processing (especially the primitive upscaling from 1080p to 4K) is a problem for a TV but actually a benefit for a monitor.
This size seems a bit overwhelming for use as a monitor. (I used to have a 30" display but got rid of it because it was too imposing on my desk.). It's still nice to see this as an option. It should be good for visualization of large data sets.