News for hackers. Stuff that matters.
Re:Inciteful: Using Citations to Explore Academic Literature by anigbrowl on Saturday December 19, 2020 @05:37PM (#25481931)
8 mentions of the 'graph' on the page. Zero renderings of the graph :(

It is a nice user interface and the reference material is useful and well presented. But when you get down to it, it's linear lists about the characteristics of a semantic graph. As I've said many times, this is like describing a tree with a tabular catalog of its leaves. Graph navigation needs a graphical representation, because things like branchiness (node out-degree) and other factors are more easily shown than described.

The basic problem with graph representation/ navigation/ traversal is that there are many valid ways of looking at the graph and it's hard to render them all. Maybe try using a gutter to allow users to temporarily pin certain graph characteristics and render accordingly. In this context, sometimes I might be interested in the latest research that cites a paper, other times I might be looking to see who picked it up first, or to apply some sort of windowing function to a large spectrum of citations.

But I want to see the graph, even if I am looking for a particular leaf.

Re:Inciteful: Using Citations to Explore Academic Literature by weishuhn on Saturday December 19, 2020 @07:16PM (#25482619)
Good feedback. Visualizations are definitely the most requested feature and something I'm working on. It's a hard problem to distill so many papers (5-150k) down into a usable graph. I've made big ones that look amazing but which are not that useful.

I like the idea of interactive filters to allow the person to explore it visually. I'm hoping to have something people can play with in the next few weeks. I hadn't really expected the site to take off the way it has and so it's not really feature complete yet :)

Re:Inciteful: Using Citations to Explore Academic Literature by anigbrowl on Saturday December 19, 2020 @07:33PM (#25482750)
It's outside of my technical wheelhouse, and most of what I know about graph theory is from trying to get a better handle on my domain problems, and as I get older I'm increasingly reluctant to get stalled on toolmaking.

But what you're discussing is a frequent problem with graph visualization - it's very easy to end up with 'hairball charts' that may be meaningful to the person who generated them but only because of familiarity with all the steps it took to get there, and the more inclusive the graph, the more time eaten by clustering algorithms, the more clusters produced, and the more of a cluster...well you get the idea.

As you're at an early stage of development, perhaps this technique, which trades away completeness for clarity and is relatively novel, might let you leapfrog some of those problems: https://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=8896846

Re:Inciteful: Using Citations to Explore Academic Literature by weishuhn on Monday December 21, 2020 @05:57AM (#25493794)
This looks super interesting! I'll take a look. Thanks.
Re:Inciteful: Using Citations to Explore Academic Literature by austinjp on Sunday December 20, 2020 @04:29AM (#25485031)
I've no idea about Rust, but in Python land you might want to check out Graph Tool and similar tools. As you note, layout of large graphs is not trivial.