Re:33TB of text data for a 1T-parameter model
by philipkglass on Sunday April 16, 2023 @01:35PM
(#35592282)
That's a good point. I wonder how LLMs currently deal with the passage of time, if they can at all. Do they know that Satya Nadella is the current CEO of Microsoft and that Steve Ballmer no longer is simply because there are more training documents reflecting the present state of things, or is there an explicit time component that helps to resolve conflicting facts from different years? Based on what I've read so far about LLMs (and not actually working on any of these models myself), I wouldn't have thought they model time or facts in a way that you could expect them to resolve conflicting claims from a 1980 document and a 2020 document. Yet they're unreasonably effective at question answering anyway.
[ Parent
| on HN ]
There are no comments on this comment yet.