It's the transfer and bandwidth that are the problem. There isn't really such a thing as "unlimited transfer" (there's a hidden limit past which they'll rate-limit you, and kindly ask to stop or pay more). Moreover, once your video gets somewhat popular, you'll hit bandwidth issues. Given how popularity on the Internet seems to happen in spikes, this will likely severely limit the reach of your video.
People are also spoiled by big video services with unlimited budgets and CDNs all around the world.
Is there a single video format supported by all browsers yet?
The number of naysayers that are implying that working with videos is so hard in these comments is shocking to me for such a supposedly technical group of people.
If you are really really popular investing in a cdn is likely the only solution and for this you need some money, be it from advertising, donations or memberships. But this is the same on Youtube too, only that Youtube does the advertising for you and takes a cut.
I would give it a go myself but I only have audio!
I think the hosting is not the problem. But the social features that YouTube provides are not easily replaced...