Re:LLaMA2 isn't “Open Source” – and why it doesn't matter
by jstarfish on Friday July 21, 2023 @03:00PM
(#36818000)
Instruction-tuning is the obvious use case. That much has nothing to do with subjectivity, alignment or censorship, it's will-you-actually-show-this-as-JSON-if-asked.
[ Parent
| on HN ]
Re:LLaMA2 isn't “Open Source” – and why it doesn't matter
by moffkalast on Friday July 21, 2023 @03:37PM
(#36818531)
That's tuning llama which is allowed from what I understand.
Otherwise why release it at all, it's not very functional in its initial state anyway. What that applies to is using llama outputs to train a completely new base model which makes no practical sense.
As for generating jsons, that's more of a inference runtime thing, since you need to pick the top tokens that result a valid json instead of just hoping it returns something that can be parsed. On top of extensive tuning of course.