Snowflake Arctic: 480B-total / 17B-active MoE under Apache 2.0
In one sentence Snowflake releases Arctic, a hybrid Dense-MoE model with 480B total and 17B active parameters, geared toward SQL, coding and instruction following, under Apache 2.0 and with a stated training cost below 2 million dollars.
Arctic is the language model from Snowflake, the company known for its cloud data warehouse. It uses a Mixture of Experts design: 480 billion parameters in total, but only 17 billion active per token.
Snowflake targets enterprise tasks: SQL generation, coding and instruction following. It claims results comparable to Llama 3 70B on these metrics with far less training compute.
Weights and code are released under Apache 2.0, ungated, together with the data recipes.
Companies
Snowflake
Tools
Snowflake Arctic
Tags
Sources