Micron (MU.US) mass produces industry's highest capacity LPDRAM, aggressively targeting the AI inference and high-performance computing market.

Micron Technology, Inc. (MU.US) has started delivering samples of the 256GB SOCAMM2 to customers, claiming it to be the highest capacity LPDRAM module currently available. The module features Micron's industry-first single-crystal 32Gb LPDDR5X design, providing low-power memory capacity to enable new system architectures. Raj Narasimhan, Senior Vice President and General Manager of Micron's Cloud Memory Business Unit, stated, "Micron's introduction of the 256GB SOCAMM2 offers the most power-efficient CPU direct-attach memory solution for AI and HPC. Today's announcement underscores Micron's advancements in technology and packaging, delivering the highest-capacity, lowest-power modular memory solution in the industry in the smallest footprint." This new module offers one-third more capacity than the previous highest capacity 192GB SOCAMM2, with each 8-channel CPU supporting 2TB of LPDRAM, suitable for larger context windows and complex inference workloads. In AI servers, SOCAMM2 addresses the "memory wall" issue. It is more power-efficient and cooler than traditional RDIMM solutions, greatly increasing the compute density of racks (larger Context Window, stronger capacity for processing complex tasks). Compared to RDIMM modules of similar specifications, its power consumption is only one-third, while occupying only one-third of the space.