News for hackers. Stuff that matters.
Re:Scaling Transformer to 1M tokens and beyond with RMT by afro88 on Monday April 24, 2023 @05:27AM (#35685381)
I have access to it through Azure.

First you need to get approved for OpenAI access via Azure Cognitive Services: https://customervoice.microsoft.com/Pages/ResponsePage.aspx?...

Then you need to get approved for GPT4: https://customervoice.microsoft.com/Pages/ResponsePage.aspx?...

Once approved for GPT4, you'll have access to the GPT4-32k model.

Re:Scaling Transformer to 1M tokens and beyond with RMT by mdp2021 on Monday April 24, 2023 @05:41AM (#35685460)
Do you have any remarks to share?
Re:Scaling Transformer to 1M tokens and beyond with RMT by youssefabdelm on Monday April 24, 2023 @05:42AM (#35685468)
With image input capability?
Re:Scaling Transformer to 1M tokens and beyond with RMT by afro88 on Monday April 24, 2023 @04:29PM (#35692759)
Unfortunately not
Re:Scaling Transformer to 1M tokens and beyond with RMT by cubefox on Monday April 24, 2023 @05:43AM (#35685476)
Are there other OpenAI models only available via Azure? I think code-davinci-002, the GPT-3.5 base model, is now only available via Azure. The GPT-4 base model seems to be completely unavailable. The OpenAI playground only has the old GPT-3 base model, davinci.
Re:Scaling Transformer to 1M tokens and beyond with RMT by afro88 on Monday April 24, 2023 @05:25PM (#35693495)
code-davinci-002 is the model used for code completions.

Here's the full list of models: https://learn.microsoft.com/en-us/azure/cognitive-services/o...

Re:Scaling Transformer to 1M tokens and beyond with RMT by cubefox on Tuesday April 25, 2023 @01:05PM (#35703433)
Yeah, it can be also used for that, but the Azure characterization is misleading. The fact is that code-davinci-002 is the GPT-3.5 foundation model, the naked token predictor without any fine-tuning applied to it. See

https://platform.openai.com/docs/model-index-for-researchers

This makes it a very powerful tool in general, since it doesn't suffer from mode collapse. It can be used for anything, though one has to prompt it right, since it doesn't follow instructions by default.

Re:Scaling Transformer to 1M tokens and beyond with RMT by capableweb on Monday April 24, 2023 @05:48AM (#35685501)
Ah, that's unfortunate, I've applied to get access to that a while ago but never heard back, while getting access to API GPT4 just took a day or something. Oh well, at least it does exist after all :)
Re:Scaling Transformer to 1M tokens and beyond with RMT by napier on Monday April 24, 2023 @06:21AM (#35685702)
Is it possible to get access to the base model (ie no RLHF) via Azure? Or even the version that’s part of Goodbing?
Re:Scaling Transformer to 1M tokens and beyond with RMT by sebzim4500 on Monday April 24, 2023 @07:18AM (#35686136)
No, it is my understanding that even MS research employees do not have access to that anymore.
Re:Scaling Transformer to 1M tokens and beyond with RMT by narrator on Tuesday April 25, 2023 @06:20AM (#35698542)
That's some sci-fi stuff right there. A model so bad that even your researchers aren't allowed to talk to it.