Microsoft Sees Composable Memory as a Future Direction for AI

Microsoft has identified memory as a constraint on AI inference, while principal architect Samir Rajadnya described composable architecture as a possible direction over the next several years, not a new Azure deployment. Composable memory separates capacity from individual servers so systems can allocate it to workloads as needed. Microsoft has not announced a composable-memory deployment for Azure AI workloads. Microsoft has said AI inference performance is limited by the memory needed to keep larger models and longer contexts available to computing systems. Its stated work spans model changes, software management, silicon efficiency and compiler placement.

BeCrypto News shows a short excerpt and links to the publisher. The full report belongs to TokenPost.