Mistral: Our first AI endpoints are available in early access

Re:Mistral: Our first AI endpoints are available in early ac... by willyyr on Monday December 11, 2023 @06:52AM (#38599788)

Mark Russinovich shares some of it in this recent Ignite session: https://ignite.microsoft.com/en-US/sessions/49347847-9ae4-43... *I work at Microsoft but have nothing to do with the datacenter engineering or other insights into the details behind it.

[ Parent | on HN ]

Re:Mistral: Our first AI endpoints are available in early ac... by zurfer on Monday December 11, 2023 @08:35AM (#38600487)

So 14400 H100 for GPT-4, but that's just a fraction of the new system that Azure is building for OpenAI.

FWIW, I most enjoyed the 29TB machine demo at the end.

[ Parent | on HN ]