News for hackers. Stuff that matters.

A comment on Show HN: I built an auto aggregating bot, collecting trending funny pictures. Parent comment

Re:Show HN: I built an auto aggregating bot, collecting tren... by rezashirazian on Friday September 16, 2016 @02:01AM (#12512151)
Ruby on Rails for the backend, Angular on the front. It's hosted on Heroku, it uses cloudfront, S3 for storage, Postgres for DB along with httpClient and mechanize for crawling and Paperclip for image manipulation.
[ Parent | on HN ]
Re:Show HN: I built an auto aggregating bot, collecting tren... by ksashikumar on Friday September 16, 2016 @03:36AM (#12512488)
Do you use any kinda algorithm for crawling/fetching content from reddit?
[ Parent | on HN ]
Re:Show HN: I built an auto aggregating bot, collecting tren... by rezashirazian on Friday September 16, 2016 @11:03AM (#12514476)
Not particularly. The one thing that helps but most people don't know about reddit is the fact that adding a .json to the end of each url displays the content of that page in json format.

for example: reddit.com/r/funny.json

This make crawling/fetching content from reddit much more trivial than old school web crawling.

[ Parent | on HN ]