News for hackers. Stuff that matters.

A comment on Building LLMs from the Ground Up: A 3-Hour Coding Workshop. Parent comment

Re:Building LLMs from the Ground Up: A 3-Hour Coding Workshop by aDyslecticCrow on Monday September 02, 2024 @10:19AM (#41425582)
Yes, if you want an LLM that doesn't listen to instructions and just endlessly babbles about anything and everything.

What turned GPT into chatGPT was a lot of structured training with human feedback.

[ Parent | on HN ]
Re:Building LLMs from the Ground Up: A 3-Hour Coding Workshop by rahimnathwani on Tuesday September 03, 2024 @11:47PM (#41441714)
Exactly. Section 4.3.7 briefly explains how they trained the model to better follow instructions ('steerability').
[ Parent | on HN ]