Giga Computing, a subsidiary of GIGABYTE, recently introduced solutions to tackle complex AI workloads and improve energy efficiency through advanced cooling infrastructure. As an NVIDIA-certified system provider, GIGABYTE servers now support NVIDIA NIM inference microservices, part of the NVIDIA AI Enterprise software platform.
Giga Computing, a subsidiary of GIGABYTE, recently introduced solutions to tackle complex AI workloads and improve energy efficiency through advanced cooling infrastructure. As an NVIDIA-certified system provider, GIGABYTE servers now support NVIDIA NIM inference microservices, part of the NVIDIA AI Enterprise software platform.
GIGABYTE showcased its latest CPU and accelerated computing technologies, including the GIGA POD, a rack-scale AI solution. The flexibility of GIGA POD is demonstrated with the latest NVIDIA solutions, such as the HGX B100, HGX H200, GH200 Grace Hopper Superchip, and other OAM baseboard GPU systems. This turnkey solution supports baseboard accelerators at scale, integrating switches, networking, compute nodes, and more while leveraging NVIDIA Spectrum-X for robust networking capabilities in generative AI infrastructures.
A highlight of the showcase was the NVIDIA GB200 NVL72 system. This system provides 30 times faster real-time large language model (LLM) inference, reduces total cost of ownership (TCO) by 25 times, and consumes 25 times less energy. The liquid-cooled, rack-scale solution connects 36 NVIDIA Grace CPUs and 72 NVIDIA Blackwell GPUs using NVIDIA NVLink, forming a single, massive GPU with 130 terabytes per second (TB/s) bandwidth.
Integrating Advanced Cooling Solutions
GIGABYTE’s portfolio includes direct liquid cooling (DLC) and single-phase immersion cooling technologies, which are essential for next-generation computing and demand better heat dissipation than traditional air cooling. The GIGABYTE DLC rack features servers for AMD, Intel, and NVIDIA technologies, supported by CDU partners CoolIT Systems and Motivair.
Key products showcased include:
- G4L3-SD1: A DLC server supporting dual Intel Xeon processors and the NVIDIA HGX B200 8-GPU, utilizing cold plates for efficient cooling.
- G593-ZX1: A server equipped with liquid cooling for AMD EPYC 9004 processors and OAM modules demonstrating high-performance cooling solutions.
Unleashing Data from Cloud to Edge
GIGABYTE presented a variety of servers, from general-purpose to ARM-based platforms and OCP solutions, aimed at both cloud and edge applications. Novel systems on display included storage servers supporting E3.S or E1.S drives and servers prepared for the next-generation AMD EPYC processors. In total, over 25 servers were showcased.
GIGABYTE motherboards for processors such as the AMD EPYC 4004, Intel Xeon W-3400, and Intel Xeon 6 series come with server-grade features, including RAS and a BMC chip. These motherboards are part of a lineup that includes entry-level servers and Broadcom-based solutions for HBA, RAID, and OCP LAN cards. This hardware is designed to be flexible, versatile, and reliable, with remote server management and monitoring capabilities.
GIGABYTE expects the NVIDIA GB200 NVL72 systems to be available in Q1 2025.
Engage with StorageReview
Newsletter | YouTube | Podcast iTunes/Spotify | Instagram | Twitter | TikTok | RSS Feed
