News for hackers. Stuff that matters.
Re:Show HN: I built an auto aggregating bot, collecting tren... by ksashikumar on Friday September 16, 2016 @03:36AM (#12512488)
Do you use any kinda algorithm for crawling/fetching content from reddit?
Re:Show HN: I built an auto aggregating bot, collecting tren... by rezashirazian on Friday September 16, 2016 @11:03AM (#12514476)
Not particularly. The one thing that helps but most people don't know about reddit is the fact that adding a .json to the end of each url displays the content of that page in json format.

for example: reddit.com/r/funny.json

This make crawling/fetching content from reddit much more trivial than old school web crawling.