Except it doesn't work in Firefox because of open source politics! If you want the same video file to appear in any browser this still requires Flash unfortunately. (And supporting multiple encodings for everything you produce can be expensive in terms of processing power, storage, maintenance, and so on.)
This is enough (look at the source, that's all I did, except uploading the video file). Of course, custom controls and other stuff would take more effort, but just puting a video on your website is this easy, really.