News for hackers. Stuff that matters.
Re:StarCoder and StarCoderBase: 15.5B parameter models with ... by stephc_int13 on Monday May 15, 2023 @09:01PM (#35956583)
red black and minmax algorithms were not really useful, and heuristics are a kind of laborious encoding of experts human knowledge into code, so they were still trained, in an hardcodes manner.

But overall, yes, the current state of machine learning relies on huge brute force compared to animal learning.

Experts Chess players need to play many games to acquire sufficient intuitive knowledge, but they converge orders of magnitude faster than current algorithms.

This weakness might be relevant later, for very dynamic and adaptable systems.

There are no comments on this comment yet.