News for hackers. Stuff that matters.
Re:Subreddit connections by gburt on Monday May 13, 2013 @08:15PM (#5702305)
It's unfortunate you removed all the primary subreddits (or degree > 75), it makes a lot of the networks confusing (the gaming network, for example) because they seem to only show niche topics.
Re:Subreddit connections by cjbarber on Monday May 13, 2013 @09:51PM (#5702626)
Agree on that point. Also, I believe you have an extremely useful data set here, but the visualization of it could be improved. My goal when looking at the graph is to discover other subreddits that may be of interest, but this is very difficult to do in the current form.

Perhaps a way of inputting and highlighting subreddits of interest (as a short term solution)?

Re:Subreddit connections by asperous on Monday May 13, 2013 @08:27PM (#5702354)
This is really well done! I would recommend putting the defaults back in and playing around with and finding a good value for "remove connections that have less than" using a number based on a percentage of the posts in sub instead of an arbitrary 8 connections.

For example, remove connections from /r/programming to subs that are cross referenced from /r/programming less than 5% of the time.

Again, very nice!

Re:Subreddit connections by Karunamon on Monday May 13, 2013 @08:00PM (#5702247)
Not surprising that the drama bomb meta subreddits are the biggest connectors (TrueRedditDrama being the largest graphically).

I personally think the overall quality/SNR of the entire site would go up if meta subs (a sub who's sole purpose is to link to other subs) were banned outright. They don't seem to do anything but stir up strife and abuse.

Re:Subreddit connections by itafroma on Monday May 13, 2013 @08:53PM (#5702431)
> Not surprising that the drama bomb meta subreddits are the biggest connectors (TrueRedditDrama being the largest graphically).

The meta subreddits that are prominently featured are only so because the subreddits that have a high degree of interconnectedness were intentionally removed:

> Removed nodes with a degree greater than 75 (this was enough to get rid of every sub in the top 20 subreddits (by subscriber). Since these subs are likely to link to a wide variety of topics, an association with one of these subs is not particularly interesting to us.

This skews the graph towards subreddits (potentially, but not necessarily, meta subreddits) that are just under the arbitrary cutoff point. So all the very large, interconnected non-meta subreddits are missing, giving a skewed picture of the actual graph.

Because of this, even among meta subreddits, notable, extremely prominent ones are missing, like /r/SubredditDrama, /r/ShitRedditSays and /r/bestof.

Re:Subreddit connections by chad_oliver on Monday May 13, 2013 @09:19PM (#5702519)
A counter-example: r/DepthHub is a meta sub which is both civilized and edifying.
Re:Subreddit connections by Karunamon on Monday May 13, 2013 @09:22PM (#5702527)
Thanks for that. I've been looking for a counter-example to the rule of "meta subs are crap" for a while.
Re:Subreddit connections by surfgeko on Monday May 13, 2013 @10:48PM (#5702791)
This link I came across has a nice sampling of particularly insightful (mostly meta) subs: http://www.reddit.com/r/depthhub+academicphilosophy+aestheti...
Re:Subreddit connections by goblin89 on Tuesday May 14, 2013 @10:15AM (#5704956)
Thanks, didn't know about the plus trick that allows to read posts from multiple subreddits in one feed.
Re:Subreddit connections by Semaphor on Tuesday May 14, 2013 @05:56AM (#5703858)
/r/DailyDot and /r/TLDR are highly interesting meta subs linking to major posts of the previous day. As someone who doesn't subscribe to most defaults I'd miss the occasional interesting story without them.

And SubRedditDrama is perfect to brighten my day ;)

Re:Subreddit connections by pilooch on Tuesday May 14, 2013 @12:38AM (#5703039)
With others, I recently played around with a custom built dataset, using unsupervised machine learning to cluster the subreddits, based on content.

You can play with it here:

http://demo.xplr.com/xplr/umbreddit/

The system can be queried:

http://demo.xplr.com/xplr/umbreddit/?search=cyclists

http://demo.xplr.com/xplr/umbreddit/?search=species

For the curious, more technical information is available here: https://xplr.com/xplr-umbrella-dataviz-on-top-of-unsupervise... and here: https://xplr.com/a-subreddit-recommender-with-xplr/

This analysis is slightly different than the study of cross-posed links. Here the content of posted URLs (not yet comments)is analyzed and subreddits are put into clusters within a search engine.

This allows the easy building of a subreddit recommender for Reddit (Chrome only for now): https://chrome.google.com/webstore/detail/preddit/epicmjpmnm...

Re:Subreddit connections by omni on Monday May 13, 2013 @08:01PM (#5702256)
This is really neat, but the magnify effect makes it absolutely infuriating to hover over one of the points to see its label.
Re:Subreddit connections by taopao on Monday May 13, 2013 @09:09PM (#5702486)
I really like the magnification effect. One of the things I don't like about these weighted graphs is that mousing to tiny targets can be a huge PITA. The magnification rectifies this.
Re:Subreddit connections by hayksaakian on Monday May 13, 2013 @09:31PM (#5702559)
I think a flat magnification would solve this. (eg real magnifying glass). The "curvy" magnification is simply annoying.
Re:Subreddit connections by nthitz on Monday May 13, 2013 @07:53PM (#5702215)
Very neat! I wonder if there would be a decent way of including more of some of the default subs without adding too much noise.
Re:Subreddit connections by Donovan on Monday May 13, 2013 @08:11PM (#5702288)
This is really useful to me, I'm always wondering about specific subreddits that may interest me. Now I can actually find them. I think there may be other ways to present this information to help people discover subreddits of interest.
Re:Subreddit connections by pilooch on Tuesday May 14, 2013 @12:43AM (#5703050)
Re:Subreddit connections by SkyMarshal on Wednesday May 15, 2013 @03:27PM (#5714198)
Can anyone find the cluster of technical/programming subreddits? Closest ones I see are the Startup hub, and java_help. I know they're in there somewhere though.
Re:Subreddit connections by cocoflunchy on Tuesday May 14, 2013 @12:08AM (#5702970)
Nice work! This got me to venture into some sad subreddits though... Had no idea that /r/niggers was even a thing (wouldn't it even be illegal?).
Re:Subreddit connections by baby on Tuesday May 14, 2013 @07:51AM (#5704238)
I don't know why you're getting downvoted. Discovered that subreddit through r/ImGoingToHellForThis which is becoming more and more a racist subreddit. I asked there the same question and learned that American put freedom of speech before hate speech and racism (which is not the case in many other countries, France for example).

This is why you have the Tea party and other jokes in the US.

Reddit is following a clear "US" guiderule which is "whatever goes".

Re:Subreddit connections by throwaway420 on Tuesday May 14, 2013 @12:28AM (#5703015)
Why would something that's distasteful be automatically illegal?
Re:Subreddit connections by ceol on Tuesday May 14, 2013 @12:56AM (#5703079)
It's not just distasteful. There is legitimate hate speech there, which some countries deem illegal.
Re:Subreddit connections by Semaphor on Tuesday May 14, 2013 @05:59AM (#5703868)
Not in the US as far as I know though and that's usually what Reddit takes as baseline. Though I think a case could be made banning them for vote brigading but that might create quite some drama considering the 2 big brigading subs (if you discount positive brigading of /r/bestof and /r/defaultgems) SRS and /r/guns are politically sensitive.
Re:Subreddit connections by wnight on Tuesday May 14, 2013 @02:55AM (#5703355)
Legitimate hate-speech.

"No sir, ours is 100% legitimate!"

Re:Subreddit connections by ceol on Tuesday May 14, 2013 @10:10PM (#5709759)
As opposed to "sarcastic" hate speech, like a joke you might hear on Tosh.0. These people really do believe the things they say, and they are intent on spreading their vitriol as far as they can.

I'm not sure what point you were trying to make, though. Unless you really didn't understand what I meant?

Re:Subreddit connections by binarysolo on Tuesday May 14, 2013 @12:40AM (#5703044)
Wow, I didn't realize a gephi file can be so easily exported to an interactive web object via sigma.js -- great, simple implementation!
Re:Subreddit connections by Achshar on Tuesday May 14, 2013 @03:52AM (#5703487)
Off topic but I don't like the "best viewed in Google Chrome". Your code should be standards compliant and it will work everywhere.
Re:Subreddit connections by bobsy on Tuesday May 14, 2013 @04:56AM (#5703678)
Why? This looks like a side project, a bit of fun. Author should be free to knock it up how they want.

It should also be noted standards compliant !== work everywhere.

Re:Subreddit connections by jacomyal on Tuesday May 14, 2013 @08:58AM (#5704520)
First, the canvas element does not work everywhere (http://caniuse.com/canvas).

Also, canvas is faster in Chrome. For instance, here is one benchmark about layered canvases (sigma.js actually layers different canvases): http://jsperf.com/layered-canvases/9

So, it is actually "best viewed in Google Chrome", despite it is indeed standards compliant.

Re:Subreddit connections by rschmitty on Monday May 13, 2013 @09:41PM (#5702585)
For some reason this runs terribly on firefox, blank in ie, chrome works great however (which you kindly point out at the end!)
Re:Subreddit connections by 1qaz2wsx3edc on Monday May 13, 2013 @07:56PM (#5702233)
"...we are all Touched by His Noodly Appendages"
Re:Subreddit connections by sneak on Monday May 13, 2013 @11:50PM (#5702927)
This reminds me vaguely of Randall Munroe's Map Of Online Communities:

http://xkcd.com/802/