Re:OpenAI employee: GPT-4.5 rumor was a hallucination
by krisoft on Sunday December 17, 2023 @06:02PM
(#38677299)
> Anyone have any ideas / knowledge on how they deploy little incremental fixes to exploited jailbreaks, etc?
LoRa[1] would be my guess.
For detailed explanation I recommend the paper. But the short explanation is that it is a trick which lets you train a smaller, lower dimensional model which when you add to the original model it gets you the result you want.
LoRa[1] would be my guess.
For detailed explanation I recommend the paper. But the short explanation is that it is a trick which lets you train a smaller, lower dimensional model which when you add to the original model it gets you the result you want.
1: https://arxiv.org/abs/2106.09685