Also I feel like people are not noticing in Tao's chat that chatGPT fairly often is doing web searches. So it literally is acting as search engine sometimes, and that too is incredibly effective when done right. So in addition to Tao using his prompts to "search/sift through vector space" the LLM is also literally just searching the web to augment its "knowledge" at inference time too.

Which, to me, again demystifies these tools. They are incredible tools, but still "just" such.