News for hackers. Stuff that matters.
Re:Every model learned by gradient descent is approximately ... by fnordpiglet on Saturday February 24, 2024 @11:36PM (#39497696)
Plumbers, lawyers, engineers all synthesize new responses to unfamiliar situations. Part of being a master plumber, which is a true trade craft and requires lots of training, mean being able to problem solve new complex situations that involves ducting of fluids. This isn’t just plunging toilets all day. Furthermore humans are actually really bad at memorization, which is essentially perfect repetition of data from the training set. In fact a large part of technical trade training is learning how to minimize generalization and maximize memorization for complex skills, but maximizing generalization and minimizing memorization for complex situations where the skills are applied.

There are no comments on this comment yet.