News for hackers. Stuff that matters.
Re:Ask HN: Video streaming is expensive yet YouTube "seems" ... by k8sToGo on Sunday May 19, 2024 @04:31PM (#40409535)
You don’t need to keep everything “hot” all the time. Storage tiers exist for a reason.
Re:Ask HN: Video streaming is expensive yet YouTube "seems" ... by pinakinathc on Sunday May 19, 2024 @04:59PM (#40409704)
Exactly! This was my go-to approach for reducing storage costs. Customers don't get spooked when they get an extra 1s delay for something they search once in a month. However, an extra 30ms delay in "everyday content" is a sure way to loose your users.

However, implementing this in practice is non-trivial. Knowing what is "everyday content" versus what is "once a month content".

To add more complexity -- you have these semi-predictable hype-waves especially two peaks in case of most YT videos where a "once-a-month" content becomes an "everyday" content before again becoming a "once-a-month" content. It feels you could specifically optimise for this -- reduce storage costs without sacrificing UX.

Re:Ask HN: Video streaming is expensive yet YouTube "seems" ... by c0balt on Sunday May 19, 2024 @09:12PM (#40411106)
> To add more complexity -- you have these semi-predictable hype-waves especially two peaks in case of most YT videos where a "once-a-month" content becomes an "everyday" content before again becoming a "once-a-month" content.

Caching is hard but this sounds like an ARC would likely catch this, if it occurs on a small number of videos concurrently.

Re:Ask HN: Video streaming is expensive yet YouTube "seems" ... by grepfru_it on Sunday May 19, 2024 @04:38PM (#40409583)
My 15 year old videos with 30 views still load nearly instantly. It’s as close to hot as hot is
Re:Ask HN: Video streaming is expensive yet YouTube "seems" ... by NBJack on Sunday May 19, 2024 @05:03PM (#40409721)
Think about what you actually need to start a video. Maybe a dozen MB?

After that, you can plunge into colder storages and warm things up as you stream. Additionally, if you need longer to 'defrost' things, just cache a few more MB at the front. Cheat a bit by assuming 480p to start with if you need to; even less to store.

Re:Ask HN: Video streaming is expensive yet YouTube "seems" ... by londons_explore on Sunday May 19, 2024 @06:33PM (#40410249)
There is also location location location.

Maybe Google holds your content in 7 data centers round the world (~1 per continent for planned maintenance + latency + reduced oceanic fiber usage).

But with old rarely streamed content they might cut that down to just 3.

Re:Ask HN: Video streaming is expensive yet YouTube "seems" ... by crazygringo on Sunday May 19, 2024 @04:50PM (#40409648)
Speed/latency doesn't tell you much, because it's all on a hard drive somewhere.

The question is whether YT is serving up the one (redundantly-backed storage) copy they have of your almost-never-watched video, or whether it's serving it up from one of 1,000+ copies it's made across the globe for currently popular videos.

Re:Ask HN: Video streaming is expensive yet YouTube "seems" ... by SirMaster on Sunday May 19, 2024 @04:43PM (#40409608)
But they are tiny 480p files yeah?
Re:Ask HN: Video streaming is expensive yet YouTube "seems" ... by spatulon on Monday May 20, 2024 @12:17PM (#40417070)
That doesn't match my experience. I have some unlisted videos that I or a small handful of friends might go back and watch once a year, and it takes several seconds of loading before they start playing. It's very noticeably different from the near-instant loading of most videos I watch.