Re:Mistral AI raises $640M at $6B valuation
by 6bb32646d83d on Wednesday June 12, 2024 @02:12PM
(#40661131)
GPU companies providing inference on open source models (like deepinfra or togetherAI) are doing so at an extremely competitive cost, making me think that the API pricing of the big players right now is profitable.
(for example, deepinfra has wizardLM-2-8x22B at $0.65/1M output tokens, compared to $6/1M output tokens for 8x22B by Mistral - and of course Mistral has some more expensive, closed source models that perform better)
(for example, deepinfra has wizardLM-2-8x22B at $0.65/1M output tokens, compared to $6/1M output tokens for 8x22B by Mistral - and of course Mistral has some more expensive, closed source models that perform better)