News for hackers. Stuff that matters.

Ask HN: Anyone sells YouTube video lists?

I am planning to make a youtube video search engine(hopefully better than what youtube offers currently). What is a good way to collect a million video URLs other than scraping or using youtube APIs? Does anyone sell a premade list?

Followup question. How do podcast search engines get the data? Do they scrape from podcast websites?

( 2 comments | on HN )
Re:Ask HN: Anyone sells YouTube video lists? by dabmancer on Friday March 23, 2018 @04:47PM (#16662502)
Personally, I would add some data to your search engine every time a person makes a new search query by searching that same query on youtube's api (https://developers.google.com/youtube/v3/code_samples/) or by scraping the data. Now that you've got some relevant results, you can sort through those (or all of the URLs you have collected) to give a more refined list of search results. If you want to pay me to get it done, I would be fine with that too.

The problem with buying a premade list (even if there is such a thing) is that it would be a whole lot of trouble to keep it updated.

Re:Ask HN: Anyone sells YouTube video lists? by sdsdsdsdsdsds on Friday March 23, 2018 @05:20PM (#16662728)
I agree with the keeping updated part. I am just looking for a starter list of sorts. Thanks for idea regarding calling youtube in the backend, atleast until I have enough data. I will do with it.