> OrcJIT has a pretty decent caching layer

(Sadly) this is not correct. If you want to cache compiled code between sessions, your only option so far are handwritten object caches along the lines of this example:

https://github.com/llvm/llvm-project/blob/ae47d158a096abad43...