IIUC the authors are saying that if we associate the metric with the four-potential via an outer product, they get a picture coherent with the current understanding of how electromagnetism "works" in GR under certain circumstances.

I can somewhat see how to interpret the mathematics in free space. But what about when there are massive bodies in the picture? They will result in a non-flat metric... does that imply they create their own electromagnetism?