What Is ChatGPT Doing and Why Does It Work?

Re:What Is ChatGPT Doing and Why Does It Work? by scrollaway on Wednesday February 15, 2023 @07:16AM (#34802783)

The training data is also not great if you want to generalise the AI. There have been a lot of research showing that smaller datasets with better labelling make a far greater difference.

Remember, humans need less examples but far more time. We also don’t start from a blank slate: we have a lot of machinery built through evolution available from conception. And when we learn later in life we have an immense amount of prebuilt knowledge and tools at our disposal. We still need months to learn to play the piano, and years to decades to perfect it.

AI training happens in minutes to hours. I am not sure we are even spending time researching algorithms that take years to run for AI training.

[ Parent | on HN ]

Re:What Is ChatGPT Doing and Why Does It Work? by space_fountain on Wednesday February 15, 2023 @02:39PM (#34809440)

There's a fun short story by Ted Chiang where the first truly human like AI results from weird people who keep interacting with and teaching AI pets from a company that goes out of business. It touches a bit on this idea that humans get a lot of hands on time compared to AI.

https://en.wikipedia.org/wiki/The_Lifecycle_of_Software_Obje...

[ Parent | on HN ]