> LLMs won't lead to "AGI" (which we can't even clearly define).
I think one of the major problems is outside technical circles, where I get the impression plenty of people think we're already there. It's not a recent thing either, I remember having this impression last year, and it's just been growing since.
If current LLM were AGI you could just tell it to write a book or make a software project and it would do it end to end on its own, just like a human worker does.
But people tend to conflate knowledge for intelligence, many thinks that Google search is intelligent as well etc.
When we have developed catalogues of models and other tools and we start training an agent to learn how to create arbitrary graphs of/programs with those tools we might be close. Think of Demis' "play any video game" AI but with successively more complex real world problems and sensor data.