Mistral has hinted at the release of its new Large 3 and Pixtral Large models, which will be available via API-only for now. This has left the AI community eagerly anticipating open weights and greater accessibility. The update was revealed after the company released two new models, the Mistral Large 2411 and Pixtral Large 2411, on the Mistral console. The codename suggests that Mistral may officially release these models, with more information to be announced on November 24, 2024. This is in line with the naming scheme of previous models, as the Mistral Large 2407 was released on July 24, 2024.
A newer version of Pixtral, Mistral’s multimodal model, was also spotted in the list. Titled Pixtral Large 2411, it is possible that Mistral is launching another model on the same date. However, the company has not revealed any further details yet. While they recently released a small language model called Mistral 3B in October, users have been eagerly waiting for an update to their larger, flagship model.
Similarly, a 12 billion parameter Pixtral model was released in September of this year, and the addition of a ‘large’ Pixtral model indicates a significant upgrade to the model. Mistral’s most recent large model achieved an 84.0% accuracy on the MMLU benchmark, setting a new record for performance and cost efficiency in open models. It also provides strong competition in code generation and reasoning with GPT 4o and Llama 3.
The Pixtral12B model, with its 128k context window, showcases impressive multimodal capabilities and scored 52.5% in the MMLU benchmark, surpassing many of its competitors in the small model segment. Along with dense models, Mistral’s portfolio also features two mixtures of experts and MoE models—the Mixtral 8x7B and the 8x22B.
Currently, Mistral is valued at $6 billion, and their latest fundraising in July amounted to $640 million dollars. It will be interesting to see how Mistral’s new models will compete in the open source world, which is currently heating up with models from Alibaba and Tencent from China shaking up the open source ecosystem.
