Those might work to some extent but keep in mind the model doesn’t have access to outside information, and it’s going to be nearly impossible to build a social graph given Twitter API limits.

IMO the easiest way to fine tune your model would be to use something like BERT embeddings fine tuned with triplet loss i.e. (example, positive, negative) to train the model to minimize distance between similar examples and maximize between dissimilar ones.