Re:AlphaCode as a dog speaking mediocre English
by stephc_int13 on Sunday February 06, 2022 @04:34PM
(#30237240)
We've seen with ML and Chess (an go to some extent) that brute forcing the problem space is clever than using heuristics.
I think this is only true because, so far, our heuristics are not that clever.
We've already seen in games with simple rules and win conditions that giving computers data on what we think are good human games can make them perform worse than not giving them data. Most problems aren't possible for humans to ebncapsulate perfectly in a set of rules and win conditions to just leave the processing power to fill in the details, and whilst curating data and calibrating learning processes is an area we've improved hugely on to get where we are with ML, it's not something where human knowledge seems more likely to reach an inflection point than hit diminishing returns.