Re:Scaling Transformer to 1M tokens and beyond with RMT
by cubefox on Tuesday April 25, 2023 @01:05PM
(#35703433)
Yeah, it can be also used for that, but the Azure characterization is misleading. The fact is that code-davinci-002 is the GPT-3.5 foundation model, the naked token predictor without any fine-tuning applied to it. See
This makes it a very powerful tool in general, since it doesn't suffer from mode collapse. It can be used for anything, though one has to prompt it right, since it doesn't follow instructions by default.
https://platform.openai.com/docs/model-index-for-researchers
This makes it a very powerful tool in general, since it doesn't suffer from mode collapse. It can be used for anything, though one has to prompt it right, since it doesn't follow instructions by default.