Here is a good start in “low-rank adaptation” or LoRA module. A way to train/adapt a general purpose LLM to efficiently and iteratively accommodate specialize data types and knowledge. A bolt-on.

https://arxiv.org/pdf/2106.09685.pdf

Not “on top” but more “in parallel” if I understand correctly