> Isn't the entire deal with LLMs that they are trained as megaliths? How can bespoke modelling overcome the treasure trove of knowledge that megaliths can generically bring in, even in bespoke scenarios?

Think of it as a base model (the megalith) which then has the weights adjusted towards a specific use-case (SAP, for example).