Re:Spell check your entire website in one go
by dangoldin on Monday March 23, 2009 @08:53AM
(#528450)
You could always just have an option for it.
I feel people would trust your tool more if they are able to tell it what to ignore.
That was the intention of choosing CSS selectors over robots.txt or nofollow, although a checkbox to specify following robots.txt & nofollow would be useful as you say.
You can filter on any CSS3 selector & a[rel="nofollow"] would block no-follow links if you don't want them included. By default we filter out any block with a class or an id that contains "comment" which does a pretty good job of filtering a lot of user comments.