Re:Is the reversal curse in LLMs real?
by bob1029 on Wednesday November 15, 2023 @06:18AM
(#38275522)
There is no opportunity for nuance?
[ Parent
| on HN ]
Re:Is the reversal curse in LLMs real?
by sgt101 on Wednesday November 15, 2023 @08:54AM
(#38276607)
There's an opportunity to build a completely different technology.
LLM's have a specific architecture that makes them good at approximate retrieval. They have a specific learning process that makes them able to do this over a vast training set.
Doing things like reasoning about facts is possible using either symbolic or specific sub symbolic structures, but combining these with an LLM is a bit tricky. It's something that could be done for a demo in a 6hr/day/week project (depends on the demo) but to do it for real in an application... or as a robust bit of science... well... 6 people for 6 mths/years/?