parameter count

Moonshot AI’s Kimi K3, a 2.8 trillion-parameter open-weight model, utilizes “mixture-of-experts” and quantization-aware training to optimize memory over compute, potentially circumventing U.S. restrictions. This approach allows it to function with reduced computational demands, though memory requirements remain substantial. Despite impressive performance in specific benchmarks, Kimi K3 still trails leading models in overall capabilities. Its release on July 27th will offer a significant opportunity to assess its impact on the open-weight model landscape.