Kimi K3 Officially Open-Sourced: Moonshot AI Releases 2.8 Trillion Parameter Model Weights, Technical Report, and Three Infrastructure Technologies

Moonshot AI released the open-source Kimi K3 on July 27, featuring 2.8 trillion parameters and 896 routed experts. Compared to the previous K2.5 generation, K3's parameter scale increased approximately threefold, while computational efficiency improved by 2.5 times through new technologies. The architectural innovations include a hybrid attention structure that combines linear attention with gated multi-head latent attention, enhancing long-context processing. Additionally, the Stable LatentMoE routing mechanism addresses the expert collapse issue, stabilizing router gradient dynamics.