We're at the point now where an individual can get to the point of building an AGI with their own resources, provided they have the terabytes of training data downloaded, and sufficient compute to process it.

Given the appearance of a Memory prosthesis for LLMs with MemGPT, all the components are in place. Sure, the moat will continue to shrink if trends continue, but we're there already, in my opinion.