Kimi K3 open-weight model: China’s biggest AI is a bet on memory, not compute

Moonshot AI launched the Kimi K3 model with 2.8 trillion parameters on July 16, making it the largest open-weight model to date. The model employs a technique called mixture-of-experts, dividing itself into 896 specialized sections and activating only 16 at a time, significantly reducing the computation needed per word. This design allows it to circumvent computing restrictions imposed on China. This development is crucial for the AI field, highlighting how companies navigate technological constraints through innovative model design.