Re:ChatGPT – The Revolutionary Bullshit Parrot
by sho_hn on Friday March 31, 2023 @08:05PM
(#35395479)
I was thinking about this while writing earlier, and kind of made the leap that we haven't yet found a way to make the model more useful than the additional training (or at least it's not been published), so technically it would be accurate to say it like this. However, I certainly agree with you that there could potentially be other utility you could derive from the base model with alternate steps. I appreciate your comment.
There's some nuance that makes your statement not completely accurate, and Sam talks about it briefly.
ChatGPT is GPT-4 with additional training, and layers, on top of it. ChatGPT is more useful when used in a conversation mode, because it was trained based on how people liked the responses, in a conversation mode. Raw GPT-4 is harder to use, because it's not optimized for a back and fourth. It may be much more useful for other use cases, though.