News for hackers. Stuff that matters.
Re:LLM Fine Tuning Guide for Enterprises in 2023 by samstave on Sunday June 18, 2023 @09:12PM (#36386183)
May you please ELI5 what 'tuning' is?
Re:LLM Fine Tuning Guide for Enterprises in 2023 by drusepth on Sunday June 18, 2023 @10:05PM (#36386538)
Imagine you have a smart, multi-purpose robot that has been trained to be a jack-of-all-trades.

The robot knows a little about a lot of things, but the extent of its knowledge about any specific thing is generally limited.

Fine-tuning (or just tuning) basically equates to some extra training to become better at some specific task. In a very basic sense, fine-tuning a model with additional data about some task just trains the model to know more about that specific task.

For example, you might buy a general-purpose cleaning robot for the home which can do a lot of different cleaning chores, but if you have special china plates that need to be cleaned in a certain way, you would want to train your robot a little more than its factory defaults. That extra training is "fine-tuning".

Re:LLM Fine Tuning Guide for Enterprises in 2023 by samstave on Monday June 19, 2023 @11:32AM (#36392263)
Thank you, but more specifically ;

How/why/where do you know how to 'tune' the robot? Vant we have robots training other robots on specific things? Can we have a robot specific to chemistry - then have deep diving robots on specifics of a particular element, then informing the parent AI with the details a specific LLM(?) has known...

(apologies if my ignorance hurts you... I dont really know where/how to come up to speed on all this AI BS)

What do?