Moonshot AI's Kimi K3.1 Pro Deployed on AMD Instinct MI355X GPUs

Moonshot AI has announced the deployment of its latest multimodal AI model, Kimi K3.1 Pro, on AMD Instinct MI355X GPUs. The model, which features 2.8 trillion total parameters and 104 billion activated parameters, is designed to handle complex AI tasks with a one-million-token context window. This deployment leverages AMD's ATOM inference engine and vLLM for optimized performance and scalability. Kimi K3.1 Pro retains the hybrid architecture of its predecessor, Kimi K3, with 69 Kimi Delta Attention (KDA) layers and 24 latent-attention layers. It introduces a sparse indexer to each latent-attention layer, enabling the selection of 2,048 tokens of historical context per query. The model operates with an 896-expert mixture-of-experts (MoE) architecture, where 16 experts are activated per token, and uses MXFP4 quantization-aware training for efficiency.

BeCrypto News shows a short excerpt and links to the publisher. The full report belongs to Blockchain.News.