Supermicro introduces rack scale plug-and-play liquid-cooled AI SuperClusters
Supermicro is introducing a ready-to-deploy liquid-cooled AI data centre, designed for cloud-native solutions that accelerate generative AI adoption for enterprises across industries with its SuperClusters, optimised for the NVIDIA AI Enterprise software platform for the development and deployment of generative AI. With Supermicro’s 4U liquid-cooled, NVIDIA recently introduced Blackwell GPUs can fully unleash 20 PetaFLOPS on a single GPU of AI performance and demonstrate 4X better AI training and 30X better inference performance than the previous GPUs with additional cost savings. Aligned with its first-to-market strategy, Supermicro recently announced a complete line of NVIDIA Blackwell architecture-based products for the new NVIDIA HGXTM B100, B200, and GB200 Grace Blackwell Superchip.
At COMPUTEX 2024, Supermicro is revealing its upcoming systems optimised for the NVIDIA Blackwell GPU, including a 10U air-cooled and a 4U liquid-cooled NVIDIA HGX B200-based system. In addition, Supermicro will be offering an 8U air-cooled NVIDIA HGX B100 system and Supermicro’s NVIDIA GB200 NVL72 rack containing 72 interconnected GPUs with NVIDIA NVLink Switches, as well as the new NVIDIA MGX systems supporting NVIDIA H200 NVL PCIe GPUs and the newly announced NVIDIA GB200 NVL2 architecture.
The rapid development of large language models and the continuous new introductions of open-source models such as Meta’s Llama-3 and Mistral’s Mixtral 8x22B make today’s state-of-the-art AI models more accessible for enterprises. The need to simplify the AI infrastructure and provide accessibility in the most cost-efficient way is paramount to supporting the current breakneck speed of the AI revolution. According to Supermicro, cloud-native AI SuperCluster bridges the gap between cloud convenience of instant access and portability, leveraging the NVIDIA AI Enterprise, allowing moving AI projects from pilot to production seamlessly at any scale. This provides the flexibility to run anywhere with securely managed data, including self-hosted systems or on-premises large data centres.
With enterprises across industries rapidly experimenting with generative AI use cases, Supermicro collaborates closely with NVIDIA to ensure a seamless and flexible transition from experimentation and piloting AI applications to production deployment and large-scale data centre AI. This result is achieved through rack and cluster-level optimisation with the NVIDIA AI Enterprise software platform, enabling a smooth journey from initial exploration to scalable AI implementation.
Managed services compromise infrastructure choices, data sharing, and generative AI strategy control. NVIDIA NIM microservices, part of NVIDIA AI Enterprise, offer managed generative AI and open-source deployment benefits without drawbacks. Its versatile inference runtime with microservices accelerates generative AI deployment across a wide range of models, from open-source to NVIDIA’s foundation models. In addition, NVIDIA NeMo enables custom model development with data curation, advanced customisation, and retrieval-augmented generation (RAG) for enterprise-ready solutions. Combined with Supermicro’s NVIDIA AI Enterprise ready SuperClusters, NVIDIA NIM provides the fastest path to scalable, accelerated Generative AI production deployments.
Supermicro SuperClusters are NVIDIA AI Enterprise ready with NVIDIA NIM microservices and NVIDIA NeMo platform for end-to-end generative AI customisation and optimised for NVIDIA Quantum-2 InfiniBand as well as the new NVIDIA Spectrum-X Ethernet platform with 400Gb/s of networking speed per GPU for scaling out to a large cluster with tens of thousands of GPUs.
