News for hackers. Stuff that matters.

Show HN: Freebie finding site using interesting algorithm

A little while ago I built an automated website that finds free stuff while filtering out scams. It works in an interesting way. Most freebie sites on the web contain a mix of real, useful free stuff and scammy affiliate and pyramid schemes. I realized that affiliate links are always unique (because they need to contain an affiliate code) while real freebies have URLs that co-occur across multiple sites at roughly the same time. I wrote a crawler in Perl and MySQL that looks for repeating, off-domain URLs that temporally cluster on multiple free stuff sites. I was surprised and pleased to find that this trick eliminates affiliate links with almost 100% success and tends to find real freebies. I then let users rate freebies and provide category and description information.

Here's the result: http://absurdlycool.com

Do you folks have suggestions about how I could make the site more useful? I recently worked on a redesign, but I'm a programmer, not a graphic designer :)

( 5 comments | 15 points | on HN )
Re:Show HN: Freebie finding site using interesting algorithm by ideadude on Tuesday May 17, 2011 @07:58PM (#2558501)
Never new how this actually worked. Thanks for sharing. I hope others have some good suggestions.
Re:Show HN: Freebie finding site using interesting algorithm by todd3834 on Tuesday May 17, 2011 @07:32PM (#2558428)
Re:Show HN: Freebie finding site using interesting algorithm by suking on Tuesday May 17, 2011 @08:42PM (#2558605)
99designs.com fast
Re:Show HN: Freebie finding site using interesting algorithm by tectonic on Tuesday May 17, 2011 @08:45PM (#2558614)
Does it work pretty well?
Re:Show HN: Freebie finding site using interesting algorithm by suking on Wednesday May 18, 2011 @10:19AM (#2560212)
yes