High Open Source Models · 1 min read
Mistral 7B: Europe joins the open-source race
In one sentence Mistral AI (Paris), a three-month-old startup founded by ex-Meta/DeepMind researchers, releases Mistral 7B under Apache 2.0. Beats Llama 2 13B on most benchmarks with half the parameters.
Reading level
A three-month-old French startup tweets a torrent link (yes, really) to the Mistral 7B weights. Apache 2.0 license — as permissive as it gets, none of the Llama 2 restrictions.
The model is small (7 billion parameters) but outperforms Llama 2 13B on most benchmarks. Runs on a 16 GB consumer GPU, even on Mac M1/M2.
For the first time Europe has a frontier player in the LLM race, and the "purest" open model around at the time.
Companies
Mistral AI
Tools
Mistral 7B
Tags
MistralMistral 7BOpen SourceApache 2.0Europe
Sources