News: Chinese AI startup Moonshot AI launched Kimi K3, the world's first open-source AI model in the 3-trillion-parameter class.

About

• Kimi K3 is a multimodal, open-weight Large Language Model (LLM) designed for advanced reasoning, coding, and enterprise applications.
• Built with 8 trillion total parameters, making it the largest open-source AI model released to date.
• Developer: Moonshot AI (Beijing, China).

Key Technologies

• Sparse Latent Mixture-of-Experts (MoE): Uses 896 experts, activating only 16 experts per token for computational efficiency.
• Kimi Delta Attention (KDA): Enables efficient processing of very large context windows.
• Attention Residuals (AttnRes): Improves long-horizon reasoning and multi-step problem-solving.

Key Features

• 1 Million-token context window for processing massive documents and codebases.
• Supports autonomous software engineering, long-horizon coding, and compiler design.
• Multimodal capabilities (text, image, and spatial reasoning).
• Released as an open-weight model on Hugging Face for research and self-hosting.

Significance

• Demonstrates China's growing capability in frontier AI.
• Expands access to advanced AI through open-source/open-weight availability.
• Reduces development costs and promotes global AI research and innovation.