News for hackers. Stuff that matters.

A comment on Every model learned by gradient descent is approximately a kernel machine (2020). Parent comment

Re:Every model learned by gradient descent is approximately ... by quantum_state on Sunday February 25, 2024 @08:15AM (#39500549)
It’s fitting a function to data and guessing the value of the function for a new input. It does not know what is under the hood of the function, etc., and see the implications when the function produces a wrong value … etc.
[ Parent | on HN ]
Re:Every model learned by gradient descent is approximately ... by astrange on Sunday February 25, 2024 @09:09PM (#39506942)
It can do that. Verifying an answer is just another algorithm it can learn.

LLMs mostly can't do math but that, like most of their other flaws, is because of the tokenizer.

[ Parent | on HN ]