News for hackers. Stuff that matters.
Re:Machine Learning and Link Spam: My Brush With Insanity by ZeroCoin on Thursday April 25, 2013 @12:17AM (#5605681)
The problem now is that (imho) 99% of the links posted on the internet are spam.

Unless you have a baseline of "what was here first" and "exactly when every website went live with what links" like Google does (because they have been indexing websites since the dawn of time as far as the internet and linking is concerned. Heck, there wasn't even backlink spamming prior to Google because Google was the first search engine to rank by number of backlinks!)... you're going to have a really tough time determining what spam is and what it isn't.

Which 1% do you decide to focus in on?

Re:Machine Learning and Link Spam: My Brush With Insanity by dchuk on Thursday April 25, 2013 @12:29AM (#5605715)
Just because a link is added to content after the content already exists doesn't immediately qualify it as spam. 99% of links being spam is a pretty massive assertion, is that anecdotal or backed by any actual data?
Re:Machine Learning and Link Spam: My Brush With Insanity by ZeroCoin on Thursday April 25, 2013 @01:11AM (#5605813)
"doesn't immediately qualify it as spam", no. That's correct.

It does however make it very difficult to gauge who is a legitimate linker and who is not.

All I'm really saying is if you're starting now with all of the years of random linkspam backscatter is that you are in for a rough ride.

Re:Machine Learning and Link Spam: My Brush With Insanity by TomAnthony on Thursday April 25, 2013 @04:34AM (#5606211)
Even if you have had a perfect history of when links appeared you're still in the a rough ride. Furthermore, absence of the that information doesn't invalidate the author's approach (but having it might improve its effectiveness).

As an aside, you have use Ahrefs.com to get pretty decent tracking of when links appeared since it started (I think ~18 months ago or so). Given that the rate of spammy pages is increasing extremely fast and old spam pages are dying off, I imagine that in the not too distant future you'll be able to get decent link history for many sites.

Re:Machine Learning and Link Spam: My Brush With Insanity by wfunction on Thursday April 25, 2013 @12:44AM (#5605748)
> 99% of the links posted on the internet are spam.

Oops, I just clicked Reply to your comment.