Snowflake Arctic: 480B total / 17B active MoE, enterprise SQL SOTA
In one sentence Snowflake releases Arctic, a MoE with 480B total and 17B active parameters per token, SOTA on enterprise SQL and coding, Apache 2.0, trained with 3.5M GPU-hours on H100.
Arctic is Snowflake's model — a large company specializing in databases and data analytics. The model uses a technique called Mixture of Experts: it has nearly 500 billion parameters in total, but for each response uses only 17 billion, making it much faster and cheaper to run.
Its specialty is SQL code and database queries, where it achieves state-of-the-art performance among open-source models.
It was trained with a massive investment — 3.5 million GPU hours on H100 chips — and released under a completely open license (Apache 2.0).
Companies
Snowflake
Tools
Snowflake Arctic
Tags
Sources