Does a definition of a word in a dictionary provide the syntax or the semantics of the word it defined?
Re:Chatbots Don’t Know What Stuff Isn’t
by somewhereoutth on Saturday May 13, 2023 @10:23AM
(#35928721)
In common use by humans, it provides semantics, in terms of other previously understood semantics. However, if there is no semantic understanding by the reader, then all it provides is a syntactic rewrite rule for each word.
You are disagreeing philosophically. That is not a technical argument.
If you are right about this, then you should edit or delete this wikipedia article and publish a paper to inform all NLP researchers that there is no such thing as a semantic similarity metric because NLP models cannot understand semantics.
So to be precise it mechanically builds a deeply layered syntactic model. LLMs just regurgitate syntax, any semantics can only be imagined by us and overlaid on the syntactic results produced.