LLM is already a misnomer. Many of the latest models are better called LFMs (Large Foundation Models). They have multimodal capabilities. Some can even handle sensory input humans can't.

Another comment already links to demos and papers of LFMs operating robots and agents in 3D environments.