Re:Our Humble Attempt at “How Much Data Is Needed to Fine-Tune
by Phemist on Monday September 25, 2023 @03:32AM
(#37640599)
Funny, as a corollary to how impractical a game engine would be in CSS: my first pass over the text had me reading CSS as something like C Sharp Sharp. A non-existent language that, according to my brain, still seems like a more likely language to build the game engine in
Re:Our Humble Attempt at “How Much Data Is Needed to Fine-Tune
by TeMPOraL on Monday September 25, 2023 @05:23AM
(#37641272)
Or, in other words, you were hallucinating, in the LLM sense.
The answer for someone asking that question is a strict no. Many people asking this stuff only have access to SFT, so it's a super no for them.
Honestly I don't get this weird obsession right now with LLMs and throwing random roadblocks in any sort of common knowledge of the subject. If someone in CS 101 asked if they could write a game engine in CSS you wouldn't get people lining up to tell them the answer isn't "No." despite it technically being possible (https://github.com/brookjordan/css-game-engine) because we understand that sometimes to enable understanding of a subject you need to setup some solid ground for new entrants to stand on.
Fine-tuning is not for knowledge. If you get comfortable enough to start experimenting with that application, you'll understand that there's some nuance to that statement either way and get to research/tinker/push boundaries armed with enough knowledge to not accept the simple no.