News for hackers. Stuff that matters.
Re:RLHF a LLM in <50 lines of Python by tgsovlerkhgsel on Sunday February 11, 2024 @05:49PM (#39339597)
Honestly the amount of complicated boilerplate that you're supposed to write from scratch every time you do something with ML (in some of the major frameworks) deterred me from touching anything ML-related for a long time.

As far as I understand, what the training loop is supposed to be doing is pretty static and you don't need to understand most of it in order to "do ML", but at the same time it's full of complicated things to get right (which would be much easier to understand when controlled through well defined parameters instead of mixing boilerplate and config).

There are no comments on this comment yet.