The 36B total / 4B active sparse model in the K2 Horizon release featuring novel MoVA attention. Ships with final weights, intermediates, code and recipes under Apache 2.0; 524k context, positioned between the dense 32B and larger flagship for on-prem deployment.

Read the official Institute of Foundation Models (MBZUAI) launch page

Worth opening first

Standouts

Playable

K2 Horizon

A collection of fully open frontier models ranging from 0.9B to 375B parameters.

Playable1

Playable

K2 Horizon

A collection of fully open frontier models ranging from 0.9B to 375B parameters.

Apps

Built something with K2 Horizon MoVA 36B-A4B?

Paste the URL and Dropday.ai will credit you, track the build as it evolves, and put it on this drop.

Submit a build