I think it's highly task-specific. In network biology for example, taking advantage of the network structure, either through node embeddings or directly, is almost always helpful (even necessary). I'm not as familiar with applications to social networks, or graph DBs.
In practice I found it almost always better to just use a "flat" representation and do regular machine learning (or database schemas). I would love to hear if others disagree.