Re:Show HN: I built an auto aggregating bot, collecting tren...
by ksashikumar on Friday September 16, 2016 @03:36AM
(#12512488)
Do you use any kinda algorithm for crawling/fetching content from reddit?
[ Parent
| on HN ]
Re:Show HN: I built an auto aggregating bot, collecting tren...
by rezashirazian on Friday September 16, 2016 @11:03AM
(#12514476)
Not particularly. The one thing that helps but most people don't know about reddit is the fact that adding a .json to the end of each url displays the content of that page in json format.
for example: reddit.com/r/funny.json
This make crawling/fetching content from reddit much more trivial than old school web crawling.