News for hackers. Stuff that matters.

A comment on Transformers Are Graph Neural Networks.

Re:Transformers Are Graph Neural Networks by ialyos on Monday March 09, 2020 @10:48AM (#22525777)
Does the use of positional embeddings mess with the gnn for formulation? I'm not familiar with the requirements for something to be a gnn, but positional embeddings mean the graphs have to capture order of occurrence, and the graph in the shared page doesn't seem to do that.
[ Parent | on HN ]
Re:Transformers Are Graph Neural Networks by chaitjo on Tuesday March 17, 2020 @08:59PM (#22612498)
In graph terms, Positional encodings are useful for adding sequential/temporal properties to each node in the graph. Indeed, there are works on position-aware GNNs.
[ Parent | on HN ]