I agree, LLM are interesting to me only to the extent that they are doing more than memorisation.
They do seem to do generalisation, to at least some degree.
If it was literal memorisation, we do literally have internet search already.
They do seem to do generalisation, to at least some degree.
If it was literal memorisation, we do literally have internet search already.
The alternative I'm considering is that It might just be that it's just a dataset problem, feeding these llms on words makes the lack a huge facet of embodied axistance that is needed to get context.
I am a nobody though, so who knows....