Re:Deep Graph Library: Easy Deep Learning on Graphs
by benibraz on Wednesday December 23, 2020 @05:51AM
(#25516362)
Is this a simplified interpretation of GNNs? because I couldn't find a reference for that.
EDIT: found it! https://arxiv.org/pdf/1609.02907.pdf
Graph NN layer: f(X, A) = g(AXW), where g is an activation
Fully connected layer: f(X) = g(XW), like GNN where the adj. matrix A=I
To put it in context a few years ago GNNs became a hot field. They are very similar in a way to transformers because both do pairwise interactions between elements, the difference being that GNNs use explicit and transformers implicit graphs.