But what I think is very interesting is that, from my totally lay-person perspective, the current challenge is scaling out the AI systems we have. We know what systems like GPT-3.5 and GPT-4 require to run and it is now an engineering challenge to scale up those systems (or drastically reduce their costs). And those systems are surprisingly GPU like. Carmack is the kind of low-level bit crunching, memory obsessed kind of guy that might be able to squeeze out the performance from the hardware.

So him teaming up with a high-level first principles math and science research type is a pretty interesting combo. There is no telling if such a partnership will ultimately result in an advancement - but on paper at least it is an interesting approach. All they are missing is a strong hardware guy (maybe Keller will go beyond investing in Carmack's Keen Technologies?).