News for hackers. Stuff that matters.
Re:Scaling Transformer to 1M tokens and beyond with RMT by cubefox on Tuesday April 25, 2023 @01:05PM (#35703433)
Yeah, it can be also used for that, but the Azure characterization is misleading. The fact is that code-davinci-002 is the GPT-3.5 foundation model, the naked token predictor without any fine-tuning applied to it. See

https://platform.openai.com/docs/model-index-for-researchers

This makes it a very powerful tool in general, since it doesn't suffer from mode collapse. It can be used for anything, though one has to prompt it right, since it doesn't follow instructions by default.

There are no comments on this comment yet.