TRAIN YOUR OWN AI ON YOUR DESK
GIGABYTE AI TOP

Train your own AI on your desk

In the age of local AI, GIGABYTE AI TOP is the all-round solution to win advantages ahead of traditional AI training methods. It features a variety of groundbreaking technologies that can be easily adapted by beginners or experts, for most common open-source LLMs, in anyplace even on your desk.

Win Advantages with GIGABYTE AI TOP

Supports 236B LLM Local Training

Intuitive Set-up

Flexbility & Upgradability

Privacy & Security

Suitable for Home Use

AI TOP Utility

Reinventing AI Training

The AI TOP Utility is a groundbreaking realization of local AI model training with reinvented workflows, user-friendly interface and experience, and real-time progress monitoring. It supports various top-ranking open-source AI models for beginners to easily start up own AI project without any skills of AI programming.

Reinvented Workflows

With friendly user interface, and real-time progress monitoring, AI TOP Utility provides a reinventing touch of local AI model training and fine-tuning.

Memory Offloading

Break the limitation of VRAM size by offloading data to system memory and even SSDs with the AI TOP Utility.

Preset Strategies

Various fine-tuning strategies such as Standard, Fast Speed, High Precision, catering to users with different needs and technical skills.

Real-time Dashboard

Real-time status of system hardware across CPU, GPU, VRAM, DRAM, SSD via a visualized dashboard.

Training Scheduler

Schedule the training experiment to run at any time, like during off-peak periods, when the cost of electricity is lower that makes your tasks more efficiently.

Get Started Now!

Run the AI TOP Utility on your AI TOP Hardware.

*Available on Linux and WSL2 on Windows 11.
AI TOP Hardware

Enhanced Performance for AI Training

The AI TOP Hardware features a series of GIGABYTE AI TOP products that are optimized in power efficiency and durability for AI training workloads. It includes upgradeable components and is easy to build at home.

Optimized Power Efficiency

Ultra Durable For Ai Training

Upgradeable Components

Easy To Build At Home

AI TOP Motherboard

Built to maximize the configuration for AI model training across CPU, GPU, memory, and SSD.

Learn more

AI TOP Graphics Card

Unleash the full potential of AI Computing with optimal cooling solutions, long-lasting designs, and instant data swapping via VRAM.

Learn more

AI TOP SSD

Supports multiple SSDs with RAID technology and capable of large-scale AI training.

Learn more

AI TOP PSU

Tested under strict simulation of AI model training to provide stability and reliability with server-grade components.

Learn more
AI TOP Recommendations

Choose the Best Setup for Your Usage

Educational Projects

AI TOP is perfect for training a small AI model from scratch to have comprehensive understanding of AI model training.

Individual AI Developers

AI TOP is the best tool to fine-tune LLMs with instant results and schedule the training experiment whenever suits you best.

Small Studios

AI TOP is affordable for small studios and provides absolute privacy and security for your proprietary datasets.

AI Workflows for SMBs

AI TOP is the ideal platform with lower TCO for small and medium-sized businesses to deploy AI models to their workflows and improve productivity.
Best Model Size For Fine-tuning 8 B 13 B 30 B 70 B
Training Time of 100K-sample 288 Hours 32 Hours 17 Hours 15 Hours
Recommeded Sets
  • GIGABYTE TRX50 AERO D
  • Ryzen Threadripper 7960X
  • Variable GIGABYTE Graphics Card Options
  • 128GB DDR5 R-DIMM
  • 1TB SSD Storage
  • GIGABYTE TRX50 AERO D
  • Ryzen Threadripper 7960X
  • Variable GIGABYTE Graphics Card Options
  • 256GB DDR5 R-DIMM
  • 2TB SSD Storage (RAID0)
  • GIGABYTE TRX50 AI TOP
  • Ryzen Threadripper 7985WX
  • Variable GIGABYTE Graphics Card Options
  • 512GB DDR5 R-DIMM
  • 2TB SSD Storage (RAID0)
  • GIGABYTE TRX50 AI TOP
  • Ryzen Threadripper 7985WX
  • Variable GIGABYTE Graphics Card Options
  • 1024GB DDR5 R-DIMM
  • 2TB SSD Storage (RAID0)
Performance

High Performance and Efficiency for AI Training

Shorter training times are better. Higher power efficiency is better.

AI TOP PC
(memory offloading: DRAM+SSD)
AI TOP PC
(memory offloading: SSD+SSD)
Regular PC
LLama-2
13B
Full fine-tuning1.3x
Full fine-tuning
Does Not Run
LLama-3
70B
LoRA fine-tuning2.4x
Full fine-tuning
Does Not Run
Power
Efficiency
7.7x

AI TOP PC: TRX50 AI TOP motherboard with Ryzen Threadripper 7985WX processer, GIGABYTE AI TOP Graphics Card Solution, 2TB of system memory, and 2x SSDs of 1TB in RAID0.
Regular PC: Z790 AORUS MASTER motherboard with Intel Core i9 13th Gen processor, 1x RTX 4090 graphics card, 64GB of system meory, and 1x SSD of 2TB.

Training configs: AI TOP Utility 1.0.1, Batch size: 4, Epochs: 1, Finetuning type: Full and LoRA. Training time: Calculated from ETA shown on Dashboard in AI TOP Utility. May vary by hardware, system and training configurations. Power efficiency: Calculated by measured tokens per watt. May vary by hardware, system and training configurations.

GIGABYTE Advantages

Why GIGABYTE AI TOP?

Pioneering in Advanced AI

In 2023, GIGABYTE established a team of AI specialists and since then works closely with partners such as Intel, AMD, and NVIDIA. Together, we pioneer in development of advanced AI technologies for our products.

Long-Term Tech Success

Founded in 1986, GIGABYTE is committed to delivering cutting-edge technology and continues to expand its products and influence, enabling customers to facilitate AI implementation.

All-round Lineup Across All Kinds of Components

GIGABYTE, as a leading innovator of computer hardware solutions, uses our hardware expertise and patented innovations to provide top-tier PC products and peripherals.

Profession and Quality in Production

GIGABYTE’s production lines are both in good supply and quality rating as we have received near 20,000 awards and accolades for innovation and design.

FAQs

  • What is AI TOP?

    AI TOP is an all-round solution for local AI model training, fine-tuning and inferencing. It consists of AI TOP Utility, a software supports up to 236B LLMs, and AI TOP Hardware, a series of PC products that are optimized in power efficiency and durability for AI training workloads.

  • How can I benefit from using AI TOP?

    AI TOP supports large language models(LLMs) of up to 236B parameters, and ensures security and privacy for your data through local training methods. It can be built on household electricity system and is flexible for future upgrades.

  • What is the AI TOP Utility?

    The AI TOP Utility is a software designed for large language models (LLMs) training. It features a graphical user interface (GUI) for you to easily initiate local AI training via friendly and intuitive experience.

  • What are the system requirements for the AI TOP Utility?

    The AI TOP Utility can only run on the AI TOP Hardware. The list of supported hardwares can be found here. As of August 2024, the AI TOP Utility is available on Linux only.

  • What large language models (LLMs) are supported by the AI TOP Utility?

    The AI TOP Utility has been tested and proven reliable with various top-ranking, open-source LLMs, such as Llama, Qwen and DeekSeek. Please refer to the manual of AI TOP Utility for detailed list of supported LLMs, which can be found in the file package.

  • How does Memory Offloading work in AI TOP Utility?

    Memory Offloading is a cutting-edge technology that significantly increases the system's capability as in the size of LLMs. It can offload the data generated during the training progress from the VRAM to the System DRAM and/or SSDs according to the current strategy. You can choose the Offloading Memory Strategy based on the LLM you are going to train or fine-tune.

  • What is the AI TOP Hardware?

    The AI TOP Hardware includes a series of motherboards, graphics cards, power supply units and solid state drives that are optimized in power efficiency and durability for intense AI training workloads.

  • What makes the AI TOP Hardware different from regular PCs?

    The AI TOP Hardware is designed to maximize the compatibility for GPUs, system memory and SSDs and provide higher power efficiency compared to regular PCs. Every AI TOP Hardware is built on quality components and tested under strict simulations for proven reliability.

  • How to choose the right configuration of AI TOP Hardware?

    AI TOP Hardware offers high flexibility and upgradability. You can build the setup based on actual usages. Some of the recommended setups can be found here.

Explore

GIGABYTE Unveils AI TOP as Solution to Local AI Training at COMPUTEX 2024

GIGABYTE, the world’s leading computer brand, announced GIGABYTE AI TOP, a groundbreaking solution for local AI on the launch event one day prior to COMPUTEX 2024. Eddie Lin, CEO of GIGABYTE declared that GIGABYTE AI TOP is born through the motto “Train Your Own AI on Your Desk,” aiming to complete the last mile in the booming era of local AI. Following GIGABYTE AI PC launched earlier this year at CES 2024, GIGABYTE AI TOP will further fuel the growth in generative AI, as the second pillar of the strategic framework of GIGABYTE AI.

Learn more

Refine Your AI Training with GIGABYTE TRX50 AI Top Motherboard!

June 4th, 2024 – GIGABYTE TECHNOLOGY Co. Ltd, a leading manufacturer of motherboards, graphics cards, and hardware solutions, presented the first flagship motherboard in the AI TOP series, the TRX50 AI TOP. With its exceptional versatility and connectivity, the TRX50 AI TOP is specially designed to unleash the ultimate computational power for your local AI training and fine-tuning.

Learn more

GIGABYTE is going all-in on white PCs, and it looks gorgeous

GIGABYTE is a Digital Trends sponsor. Editorial spotlights provide sponsors editorial consideration without approval or oversight over final coverage, which is produced according to the same unbiased standard and practices that govern all of our reporting.

Learn more

GIGABYTE just made it easy to build your own AI modeling machine

With its new AI TOP system, Gigabyte is providing specialized hardware components and software to help you build an AI-training PC at home.

Learn more