My internet connection can be flaky, and just downloading stuff and playing it locally works a lot better. YouTube tries very hard to minimize the buffer size to only what's needed – which makes a lot of sense at their scale – but it also means that less-than-stable internet connections are difficult because it'll never buffer enough to bridge the 3 minute outage.