It seems like the bigger transformer you have, the less the generated text feels like a speech of somebody with Wernicke's encepalopathy and more like a normal person, but there is still the feeling of some "brain lesion" in there somewhere.