To me one of the most interesting aspects of observing how LLM capabilities evolve is how it highlights the meaningful ways human minds remain unique and valuable. It gets into Philosophy of Mind stuff but the existence of the inner self (or the illusion it exists, if you believe Dennett) and the subjective experience of qualia do give humans both unique strengths and some of our most annoying weaknesses.
> For example humans can only hold like 7 distinct numbers in the short term memory and you would require extra context-management (aka writing things down, storing them in a system entry by entry) while the AI can do this effortlessly with huge datasets.
Correct. For a long time people wer obsessed with 'increasing context length' as if humans have some great context length system in our brains. We don't. I doubt our equivalent of 'context length' (short-term memory) is very long at all. We just have a good training process that puts these memories into long term storage.
In my opinion AI is superior to humans when it comes to pattern recognition in in large amounts of data. For example humans can only hold like 7 distinct numbers in the short term memory and you would require extra context-management (aka writing things down, storing them in a system entry by entry) while the AI can do this effortlessly with huge datasets.
I'd argue this is the core part that enables all this superhuman intelligence.