GIGABYTE Solutions for NVIDIA Blackwell GPUs: Empowering the Next Era of AI

A GPU Accelerated Era

The journey of specialized graphics components began in the 1970s, culminating in the invention of the GPU — a transformative innovation. Fast forward to half a century later, GPUs have evolved from simple circuits to individual boards, and now, modules embedded in high-density compute infrastructures. Especially with the surge in AI applications, the rapid adoption and dominance of GPUs in the industry are unprecedented, surpassing expectations.

Today, GPUs power numerous aspects of modern life: from upscaling and restoring old videos to simulating weather patterns to driving generative AI models like ChatGPT. As the demand for GPU computing resources grows exponentially, industry leaders are collaborating to achieve performance gains that defy Moore's Law. NVIDIA, a pioneer in the GPU revolution, has consistently pushed the boundaries and now introduces its Blackwell architecture, promising a significant leap forward in AI development.

Breaking Barriers in Accelerated Computing and Generative AI

Building on the tremendous success of the NVIDIA Hopper architecture, Blackwell architecture is even better designed to address the increasing complexity of AI models and their growing parameters. Using TSMC's 4nm process (4NP) technology, Blackwell GPUs integrate billions of transistors, alongside advancements such as faster, wider NVIDIA NVLink™ and the second-generation transformer engine. These innovations deliver orders of magnitude more performance than its predecessor, positioning Blackwell as a cornerstone for the next wave of AI breakthroughs.

Blackwell-architecture GPUs

208 billion transistors with TSMC 4NP process

2nd Gen Transformer Engine

Doubling the performance with FP4 enablement

5th Gen NVLink & NVLink Switch

1.8 TB/s GPU-GPU interconnect

RAS Engine

100% In-system self-test

Secure AI

Full performance encryption & TEE

Decompression Engine

800 GB/s

GIGABYTE's Commitment to Flexible and Scalable Solutions

Comprehensive One-Stop Service for Optimized Configuration

As computing architectures grow in scale and applications evolve toward specialized fields, an optimal system configuration is essential for achieving high performance and efficiency. GIGABYTE offers a comprehensive one-stop service, covering consulting to understand requirements and constraints, deployment to deliver tailored solutions, and after sales support to ensure reliability. With this thorough approach, GIGABYTE simplifies the process of deploying new systems, making them faster, easier, and more reliable across diverse scenarios.

To learn more about GIGABYTE's one-stop solution: GIGAPOD – AI Supercomputing Solution

GIGAPOD Deployment Process

NVIDIA GB300 NVL72: Built for the Age of AI Reasoning

The NVIDIA GB300 NVL72 features a fully liquid-cooled, rack-scale design that unifies 72 NVIDIA Blackwell Ultra GPUs and 36 Arm^®-based NVIDIA Grace™ CPUs in a single platform optimized for test-time scaling inference.

AI factories powered with the GB300 NVL72 using NVIDIA Quantum-X800 InfiniBand or Spectrum™-X Ethernet paired with NVIDIA ConnectX^®-8 SuperNIC™ provide a 50x higher output for reasoning model inference compared to the NVIDIA Hopper™ platform.

Download Datasheet

NVIDIA HGX™ B300 / B200: Optimized for AI and High-Performance Computing

Both built on the NVIDIA Blackwell architecture, the NVIDIA HGX™ B300 and B200 deliver the next generation of accelerated computing for data centers and generative AI. The NVIDIA HGX™ B300 further integrates Blackwell Ultra GPUs with ultra fast interconnects, pushing performance of the scale-up platform even higher, delivering up to 11× greater inference performance over the previous generation, setting new benchmarks for demanding generative AI, data analytics, and HPC workloads.

With advanced networking options supporting up to 800 Gb/s through NVIDIA Quantum-X800 InfiniBand and Spectrum™-X Ethernet, the platforms ensure unmatched AI throughput. By incorporating NVIDIA^® BlueField^®-3 DPUs, they also enable cloud networking, composable storage, zero trust security, and GPU compute elasticity for hyperscale AI environments.

To meet these next generation requirements, GIGABYTE delivers server platforms purpose built for NVIDIA HGX ™ B300 / B200, offering both 8U air cooled and 4U liquid cooled configurations. GIGABYTE servers are equipped with features designed to enhance both performance and usability, including:

(1) Support for full-height add-in cards, accommodating DPUs and SuperNICs
(2) A PCIe cage design and front-access motherboard/GPU trays for streamlined maintenance.
(3) Hot-swappable, fully redundant PSUs with multiple connector options for enhanced flexibility.

These designs address the growing power density and thermal demands of large scale AI infrastructure while ensuring deployment flexibility across diverse environments such as Neocloud data centers and high performance computing facilities.

NVIDIA HGX™ B300

8 x NVIDIA Blackwell Ultra GPUs
Up to 2.1TB of GPU memory
105 petaFLOPS training performance
144 petaFLOPS inference performance
1.8TB/s GPU-to-GPU bandwidth with NVIDIA NVLink™ and NVSwitch™

G894-SD3-AAX7

NVIDIA HGX™ B300
8 x 800 Gb/s OSFP InfiniBand XDR or Dual 400 Gb/s Ethernet GPU networking ports via onboard NVIDIA ConnectX^®-8 SuperNIC™
Compatible with NVIDIA^® BlueField^®-3 DPUs and ConnectX^®-7 NICs
Compatible with NVIDIA^® BlueField^®-3 DPUs
Dual Intel^® Xeon^® 6700/6500-Series Processors
2 x 10Gb/s LAN ports
8 x 2.5" Gen5 NVMe hot-swap bays
4 x FHHL PCIe Gen5 x16 slots
12 x 3000W 80 PLUS Titanium redundant power supplies

G4L3 4U HPC/AI Server

Liquid-cooled NVIDIA HGX™ B200
Dual 5th/4th Gen Intel^® Xeon^® Scalable or Dual AMD EPYC™ 9005/9004 Series CPUs
Compatible with NVIDIA^® BlueField^®-3 DPUs and ConnectX^®-7 NICs
2 x 10Gb/s LAN ports
8 x 2.5" Gen5 NVMe hot-swap bays
12 x FHHL PCIe Gen5 x16 slots
4+4 3000W 80 PLUS Titanium redundant PSUs

The Power of Acceleration with Blackwell

HPC

Complex problem-solving in HPC applications use numerical methods, simulations, and computations to achieve significant insights. While traditionally less dependent on GPUs, the overwhelming parallel computing power of GPGPUs has greatly accelerated the development of HPC in recent years, making hybrid configurations a growing trend in modern supercomputers.
AI

With the rapid adoption of AI, from general applications to the fast-evolving deep learning, GPGPUs have become a game changer for the industry. The parallel processing capabilities of GPGPUs allow for the handling of massive datasets and complex algorithms, which are essential for training and deploying AI models. As a result, AI has become the key to making modern systems faster and “smarter” in the most efficient way.
Science & Engineering

Research in fields such as physics, chemistry, geology, and biology greatly benefit with the use of GPU accelerated clusters. Simulations and modeling thrive with the parallel processing capability of GPUs, enabling faster computation and more accurate results. This allows researchers to analyze vast datasets, conduct detailed experiments, and achieve breakthroughs across various scientific disciplines efficiently.