I agree this is what we want, we should not waste compute and money on memorizing world knowledge, just enough world knowledge to have the best possible understanding of languages.