The transformer is a fully connected graph neural network. Read https://arxiv.org/abs/2004.08483 for further ideas.