Re:Microsoft Adds ChatGPT AI Technology to Bing Search Engine
by jimrandomh on Tuesday February 07, 2023 @02:01PM
(#34697429)
And that research is valuable, but it's definitely nowhere near the point where safety/alignment progress can't be made without a user base. A few recent favorites of mine: https://arxiv.org/pdf/2212.03827.pdf https://www.alignmentforum.org/posts/aPeJE8bSo6rAFoLqg/solid...
[ Parent
| on HN ]
Re:Microsoft Adds ChatGPT AI Technology to Bing Search Engine
by the8472 on Tuesday February 07, 2023 @03:06PM
(#34698663)
Note that that kind of research was only possible on the (smaller) open models. When the new models are proprietary ones then outsiders can't do that kind of analysis. If they had regenerated the tokenization dictionary to match the training data instead of reusing an older set then this wouldn't transfer from GPT2 to ChatGPT.