Moonshot AI
AI company specializing in advanced reasoning models with focus on research capabilities. Key innovations include mixture-of-experts architectures, specialized research agents, and novel architectural optimizations for deep LLMs.
Kimi K2
- Latest mixture-of-experts model with 32B activated parameters and 1T total parameters
- Achieves state-of-the-art performance in knowledge-intensive tasks
- Core component of Kimi-Researcher suite for complex problem-solving
Recent Breakthroughs
- Kimi Team’s Attention Residuals: LLM Deep Network Breakthrough for Pre-Norm Dilution introduces “Attention Residuals” (AttnRes), an architectural breakthrough designed to address pre-norm dilution in deep LLMs.
Research Agent Benchmarking
Video 2026 04 14 Kiki K2 Prompt Engineering compares Kimi K2 against: