I think GP's comment is probably apt if understood together with the qualification of "unless we find a better modeling architecture than Transformer".