News for hackers. Stuff that matters.

A comment on How Big Is YouTube?. Parent comment

Re:How Big Is YouTube? by justinpombrio on Saturday December 23, 2023 @12:58AM (#38742009)
That's not actually the technique the authors are using. Catching 100 fish would be analogous to "sample 100 YouTube videos at random", but they don't have a direct method of doing so. Instead, they're guessing possible YouTube video links at random and seeing how many resolve to videos.

In the "100 fish" example, the formula for approximating the total number of fish is:

    total ~= caught / tagged
    (where caught=100 in the example)
In their YouTube sampling method, the formula for approximating the total number of videos is:

    total ~= (valid / tried) * 2^64
Notice that this is flipped: in the fish example the main measurement is "tagged" (the number of fish that were tagged the second time you caught them), which is in the denominator. But when counting YouTube videos, the main measurement is "valid" (the number of urls that resolved to videos), which is in the numerator.
[ Parent | on HN ]
Re:How Big Is YouTube? by ad404b8a372f2b9 on Saturday December 23, 2023 @02:03AM (#38742268)
Did you understand where the 2^64 came from in their explanation btw? I would have thought it would be (64^10)*16 according to their description of the string.

Edit: Oh because 64^10 * 16 = (2^6)^10 * (2^4)

[ Parent | on HN ]
Re:How Big Is YouTube? by dajonker on Saturday December 23, 2023 @04:53AM (#38742980)
The YouTube identifiers are actually 64 bit integers encoded using url-safe base64 encoding. Hence the limited number of possible characters for the 11th position.
[ Parent | on HN ]