Re:After 118 days, GPT Unicorn has produced a unicorn
by christkv on Thursday August 10, 2023 @08:22AM
(#37075284)
Is it possible that inference cost is so high itβs viable?
Re:After 118 days, GPT Unicorn has produced a unicorn
by ActivePattern on Thursday August 10, 2023 @10:03AM
(#37076291)
I suspect the model is fundamentally the same underneath, but that various tricks like quantization are being performed in the deployed model to improve inference speed/cost at the expense of output quality.
I believe he's trying to find an unicorn similar in style to the one generated by the original researcher.
It's so sad that openai has a far more capable model internally that it can't give open access to because of safety (or any other argument).