Re:Show HN (again): Web-based Link Checker with Blacklist Lo...
by mcknz on Wednesday December 28, 2011 @11:27AM
(#3400273)
Looks good & works well, based on a couple of sites-- unsure on the doctor image. It's funny but it might prevent some people from taking the site seriously.
-- remove "example.com" from search box when gets focus?
-- rather than blacklist certain domains, maybe you could cap the number of link checks? With utilities like this I always try a popular site to see how it works, before entering one of my own sites. I was unable to do that, which was a little frustrating at first.
-- add a quick description of service on main page? Not sure if "check your website's links" would be obvious to everyone.
Re:Show HN (again): Web-based Link Checker with Blacklist Lo...
by tlack on Wednesday December 28, 2011 @11:25AM
(#3400261)
If you're looking for feature ideas, it might be interesting to be able to tell how deeply buried each link is from the homepage. I have some sites with a ton of content and I'd love to know how easily reached different pages are.
Re:Show HN (again): Web-based Link Checker with Blacklist Lo...
by awulf on Wednesday December 28, 2011 @12:56PM
(#3400627)
That's strange, your grep looks fine to me. Is it possible that you have configured nginx to use different log files for different locations (or maybe don't log at all)? Other than that, I don't have any good explanation.
Re:Show HN (again): Web-based Link Checker with Blacklist Lo...
by symkat on Wednesday December 28, 2011 @01:26PM
(#3400728)
Oops, I'm a dumby and hadn't had enough coffee yet. That file was just logging 301s, and the actual target was going elsewhere, which has an appropriate number of requests.
Re:Show HN (again): Web-based Link Checker with Blacklist Lo...
by awulf on Wednesday December 28, 2011 @11:00AM
(#3400154)
This is a repost from about two weeks ago. Back then, I had to remove the link after a few minutes because my little server couldn't handle the traffic spike and ran out of memory.
During the last days I have added more server power and did some major changes to make the service more robust. I hope the work was worth it.
Re:Show HN (again): Web-based Link Checker with Blacklist Lo...
by hsmyers on Wednesday December 28, 2011 @11:26AM
(#3400268)
Don't much care about links that are not broken---do care about links that ARE broken. Need some way to create a list of such and then down load the list. Like the interface and the look and feel---good work, keep going!
Re:Show HN (again): Web-based Link Checker with Blacklist Lo...
by edbloom on Tuesday January 10, 2012 @03:42PM
(#3448907)
as someone who has a good bit of asp.net and nginx experience - i never thought of using nginx as a proxy for ASP.net running on mono/linux - cool setup dude!
-- remove "example.com" from search box when gets focus?
-- rather than blacklist certain domains, maybe you could cap the number of link checks? With utilities like this I always try a popular site to see how it works, before entering one of my own sites. I was unable to do that, which was a little frustrating at first.
-- add a quick description of service on main page? Not sure if "check your website's links" would be obvious to everyone.
Also, I think it would be useful to add a section in 'About' that says the user agent the crawler will use.
Overall pretty awesome, thank you!
During the last days I have added more server power and did some major changes to make the service more robust. I hope the work was worth it.
http://moustach.io/welcome/e/reviewed/zNQi0Ddm0hFnDC4uEKvPYL...
Good luck.
I have a friend who is working on a very similar product - it will be launched sometime in the next few weeks... keep an eye out for competition ;)
- nginx
- Mono
- ASP.NET MVC 3
- FastCGI Mono Server
- MongoDB