News for hackers. Stuff that matters.
Re:AlphaCode as a dog speaking mediocre English by notahacker on Sunday February 06, 2022 @01:22PM (#30235307)
And building on that, the real bottleneck in most domains isn't going to be computer power, it's going to be human understanding of how to curate data or tweak parameters.

We've already seen in games with simple rules and win conditions that giving computers data on what we think are good human games can make them perform worse than not giving them data. Most problems aren't possible for humans to ebncapsulate perfectly in a set of rules and win conditions to just leave the processing power to fill in the details, and whilst curating data and calibrating learning processes is an area we've improved hugely on to get where we are with ML, it's not something where human knowledge seems more likely to reach an inflection point than hit diminishing returns.

Re:AlphaCode as a dog speaking mediocre English by stephc_int13 on Sunday February 06, 2022 @04:34PM (#30237240)
We've seen with ML and Chess (an go to some extent) that brute forcing the problem space is clever than using heuristics.

I think this is only true because, so far, our heuristics are not that clever.