Re:Show HN: Discover what songs were used in YouTube videos
by mo0 on Monday March 09, 2015 @07:54AM
(#9170407)
Crawling the internet for mp3s. It took us a couple of months to get to 7m.
[ Parent
| on HN ]
Re:Show HN: Discover what songs were used in YouTube videos
by tixocloud on Monday March 09, 2015 @11:40AM
(#9171495)
That's an absolutely creative way of doing it! Congrats.
I'm interested in how you did it. For example, how do you exactly "crawl the internet"? Did you have a bunch of sites that you've pre-selected and then just crawl those or did you actually follow through on links?
Thanks.
Re:Show HN: Discover what songs were used in YouTube videos
by tk42 on Monday March 09, 2015 @02:29PM
(#9172770)
One-click hosters and cloud hosters with sharing options(such as docs.google.com), several music streaming sites, usenet.
Also the amount of mp3s hosted on regular webservers which are indexed by and easily found using the usual search engines is mindblowing
Re:Show HN: Discover what songs were used in YouTube videos
by rubicon33 on Monday March 09, 2015 @12:33PM
(#9171901)
I am also interested in knowing more specifics about your crawling process (if you can divulge).
Did you just crawl random sites and search for .mp3 content on them? Or did you have a set of pre-defined search sites to craw?