Re:Show HN: Sitebulb, a website crawler and auditor for SEOs
by will_critchlow on Thursday September 28, 2017 @10:07AM
(#15357180)
"Almost everything looks like a graph. Almost nothing should be drawn as one."
It's really hard to make sense of full link graph visualisations. I'm talking about this in an upcoming conference presentation. We should share notes :)
Re:Show HN: Sitebulb, a website crawler and auditor for SEOs
by hathawayp on Thursday September 28, 2017 @10:13AM
(#15357215)
Absolutely. In development we tried different ways to make the Crawl Map also represent link data, and they were all just unintelligible. Even the Crawl Maps on big sites are hard to get your head around, and that's with Sitebulb sampling quite heavily.
I'd love for us to come up with some sort of solution for it, I just don't know how we'd do it!
SL presentation I assume?
Re:Show HN: Sitebulb, a website crawler and auditor for SEOs
by will_critchlow on Thursday September 28, 2017 @10:19AM
(#15357255)
Yep.
Will be sharing and writing about it too - still a bit of a work-in-progress. Hopefully it all comes together nicely!
I'm leaning towards comparisons between tables of data, metrics etc rather than visualisations for much of this.
Re:Show HN: Sitebulb, a website crawler and auditor for SEOs
by will_critchlow on Thursday September 28, 2017 @10:17AM
(#15357246)
Oh - I meant to say - that quote is from this book: http://shop.oreilly.com/product/9780596514556.do
Regarding Crawl Maps, yeah it does have some limitations on, which I've written about here - https://sitebulb.com/resources/guides/crawl-maps-faqs/
Although from your comment I think you might be thinking it is a link map, rather than a crawl map. So with the Crawl Map it is mapping out how each URL/node was found when the crawler traversed the site. So each node will only ever have one edge/link.
A link map ends up a LOT more messy, although it's on our roadmap to try and build one of these too!