Re:The Unpredictable Abilities Emerging from Large AI Models
by PeterisP on Friday March 17, 2023 @09:12AM
(#35196630)
> I had previously the expectation that unpredictable emergent behavior would exist in any sufficiently complex system?
Yes and no.
It's reasonable to expect that some unpredictable emergent behavior would exist in any sufficiently complex system; it's not warranted to expect whether a particular capability will or will not emerge out of that system (that's the unexpected emergent behavior part); and it also was debated whether language models are a "sufficiently complex system", as many thinkers asserted that they should encounter fundamental limits in capabilities.
Yes and no.
It's reasonable to expect that some unpredictable emergent behavior would exist in any sufficiently complex system; it's not warranted to expect whether a particular capability will or will not emerge out of that system (that's the unexpected emergent behavior part); and it also was debated whether language models are a "sufficiently complex system", as many thinkers asserted that they should encounter fundamental limits in capabilities.