Yi-34B: bilingual EN/ZH model in the open-weight top-3 of November 2023

In one sentence 01.ai by Kai-Fu Lee releases Yi-34B: 34B parameters trained on 3.1T tokens, modified Llama-2 architecture, bilingual EN/ZH, top-3 open weight in November 2023.

Verified Official source

ShareLinkedIn X

Yi-34B is a language model created by the startup 01.ai, founded by Kai-Fu Lee, one of the most prominent figures in AI in China. The model supports both English and Chinese at a high level, something few open-weight models could do in 2023.

It was trained on 3.1 trillion tokens, far more than LLaMA-2, and when released it ranked among the top three open-weight models in existence.

Yi marked an important moment: proof that Chinese startups could compete with Western labs in foundation model research.