GIGABYTE AI TOP
Train your own AI on your desk
In the age of local AI, GIGABYTE AI TOP is the all-round solution to win advantages ahead of traditional AI training methods. It features a variety of groundbreaking technologies that can be easily adapted by beginners or experts, for most common open-source LLMs, in anyplace even on your desk.
Win Advantages with GIGABYTE AI TOP
Supports 236B LLM Local Training
Intuitive Set-up
Flexbility & Upgradability
Privacy & Security
Suitable for Home Use
AI TOP Utility
Reinventing AI Training
The AI TOP Utility is a groundbreaking realization of local AI model training with reinvented workflows, user-friendly interface and experience, and real-time progress monitoring. It supports various top-ranking open-source AI models for beginners to easily start up own AI project without any skills of AI programming.
Reinvented Workflows
With friendly user interface, and real-time progress monitoring, AI TOP Utility provides a reinventing touch of local AI model training and fine-tuning.
Memory Offloading
Break the limitation of VRAM size by offloading data to system memory and even SSDs with the AI TOP Utility.
Preset Strategies
Various fine-tuning strategies such as Standard, Fast Speed, High Precision, catering to users with different needs and technical skills.
Real-time Dashboard
Real-time status of system hardware across CPU, GPU, VRAM, DRAM, SSD via a visualized dashboard.
Training Scheduler
Schedule the training experiment to run at any time, like during off-peak periods, when the cost of electricity is lower that makes your tasks more efficiently.
Get Started Now!
Run the AI TOP Utility on your AI TOP Hardware.
AI TOP Hardware
Enhanced Performance for AI Training
The AI TOP Hardware features a series of GIGABYTE AI TOP products that are optimized in power efficiency and durability for AI training workloads. It includes upgradeable components and is easy to build at home.
Optimized Power Efficiency
Ultra Durable For Ai Training
Upgradeable Components
Easy To Build At Home
AI TOP Motherboard
Built to maximize the configuration for AI model training across CPU, GPU, memory, and SSD.
Learn more
AI TOP Graphics Card
Unleash the full potential of AI Computing with optimal cooling solutions, long-lasting designs, and instant data swapping via VRAM.
Learn more
AI TOP SSD
Supports multiple SSDs with RAID technology and capable of large-scale AI training.
Learn more
AI TOP PSU
Tested under strict simulation of AI model training to provide stability and reliability with server-grade components.
Learn moreAI TOP Recommendations
Choose the Best Setup for Your Usage
Educational Projects AI TOP is perfect for training a small AI model from scratch to have comprehensive understanding of AI model training. |
Individual AI Developers AI TOP is the best tool to fine-tune LLMs with instant results and schedule the training experiment whenever suits you best. |
Small Studios AI TOP is affordable for small studios and provides absolute privacy and security for your proprietary datasets. |
AI Workflows for SMBs AI TOP is the ideal platform with lower TCO for small and medium-sized businesses to deploy AI models to their workflows and improve productivity. |
|
| Best Model Size For Fine-tuning | 8 B | 13 B | 30 B | 70 B |
| Training Time of 100K-sample | 288 Hours | 32 Hours | 17 Hours | 15 Hours |
| Recommeded Sets |
|
|
|
|
Performance
High Performance and Efficiency for AI Training
Shorter training times are better. Higher power efficiency is better.
(memory offloading: DRAM+SSD)
(memory offloading: SSD+SSD)
13B
70B
Efficiency
AI TOP PC: TRX50 AI TOP motherboard with Ryzen Threadripper 7985WX processer, GIGABYTE AI TOP Graphics Card Solution, 2TB of system memory, and 2x SSDs of 1TB in RAID0.
Regular PC: Z790 AORUS MASTER motherboard with Intel Core i9 13th Gen processor, 1x RTX 4090 graphics card, 64GB of system meory, and 1x SSD of 2TB.
Training configs: AI TOP Utility 1.0.1, Batch size: 4, Epochs: 1, Finetuning type: Full and LoRA. Training time: Calculated from ETA shown on Dashboard in AI TOP Utility. May vary by hardware, system and training configurations. Power efficiency: Calculated by measured tokens per watt. May vary by hardware, system and training configurations.
GIGABYTE Advantages
Why GIGABYTE AI TOP?
Pioneering in Advanced AI
In 2023, GIGABYTE established a team of AI specialists and since then works closely with partners such as Intel, AMD, and NVIDIA. Together, we pioneer in development of advanced AI technologies for our products.
Long-Term Tech Success
Founded in 1986, GIGABYTE is committed to delivering cutting-edge technology and continues to expand its products and influence, enabling customers to facilitate AI implementation.
All-round Lineup Across All Kinds of Components
GIGABYTE, as a leading innovator of computer hardware solutions, uses our hardware expertise and patented innovations to provide top-tier PC products and peripherals.
Profession and Quality in Production
GIGABYTE’s production lines are both in good supply and quality rating as we have received near 20,000 awards and accolades for innovation and design.
FAQs
-
What is AI TOP?
AI TOP is an all-round solution for local AI model training, fine-tuning and inferencing. It consists of AI TOP Utility, a software supports up to 236B LLMs, and AI TOP Hardware, a series of PC products that are optimized in power efficiency and durability for AI training workloads.
-
How can I benefit from using AI TOP?
AI TOP supports large language models(LLMs) of up to 236B parameters, and ensures security and privacy for your data through local training methods. It can be built on household electricity system and is flexible for future upgrades.
-
What is the AI TOP Utility?
The AI TOP Utility is a software designed for large language models (LLMs) training. It features a graphical user interface (GUI) for you to easily initiate local AI training via friendly and intuitive experience.
-
What are the system requirements for the AI TOP Utility?
The AI TOP Utility can only run on the AI TOP Hardware. The list of supported hardwares can be found here. As of August 2024, the AI TOP Utility is available on Linux only.
-
What large language models (LLMs) are supported by the AI TOP Utility?
The AI TOP Utility has been tested and proven reliable with various top-ranking, open-source LLMs, such as Llama, Qwen and DeekSeek. Please refer to the manual of AI TOP Utility for detailed list of supported LLMs, which can be found in the file package.
-
How does Memory Offloading work in AI TOP Utility?
Memory Offloading is a cutting-edge technology that significantly increases the system's capability as in the size of LLMs. It can offload the data generated during the training progress from the VRAM to the System DRAM and/or SSDs according to the current strategy. You can choose the Offloading Memory Strategy based on the LLM you are going to train or fine-tune.
-
What is the AI TOP Hardware?
The AI TOP Hardware includes a series of motherboards, graphics cards, power supply units and solid state drives that are optimized in power efficiency and durability for intense AI training workloads.
-
What makes the AI TOP Hardware different from regular PCs?
The AI TOP Hardware is designed to maximize the compatibility for GPUs, system memory and SSDs and provide higher power efficiency compared to regular PCs. Every AI TOP Hardware is built on quality components and tested under strict simulations for proven reliability.
-
How to choose the right configuration of AI TOP Hardware?
AI TOP Hardware offers high flexibility and upgradability. You can build the setup based on actual usages. Some of the recommended setups can be found here.
Explore
GIGABYTE Unveils AI TOP as Solution to Local AI Training at COMPUTEX 2024
GIGABYTE, the world’s leading computer brand, announced GIGABYTE AI TOP, a groundbreaking solution for local AI on the launch event one day prior to COMPUTEX 2024. Eddie Lin, CEO of GIGABYTE declared that GIGABYTE AI TOP is born through the motto “Train Your Own AI on Your Desk,” aiming to complete the last mile in the booming era of local AI. Following GIGABYTE AI PC launched earlier this year at CES 2024, GIGABYTE AI TOP will further fuel the growth in generative AI, as the second pillar of the strategic framework of GIGABYTE AI.
Learn more
Refine Your AI Training with GIGABYTE TRX50 AI Top Motherboard!
June 4th, 2024 – GIGABYTE TECHNOLOGY Co. Ltd, a leading manufacturer of motherboards, graphics cards, and hardware solutions, presented the first flagship motherboard in the AI TOP series, the TRX50 AI TOP. With its exceptional versatility and connectivity, the TRX50 AI TOP is specially designed to unleash the ultimate computational power for your local AI training and fine-tuning.
Learn more
GIGABYTE is going all-in on white PCs, and it looks gorgeous
GIGABYTE is a Digital Trends sponsor. Editorial spotlights provide sponsors editorial consideration without approval or oversight over final coverage, which is produced according to the same unbiased standard and practices that govern all of our reporting.
Learn more
GIGABYTE just made it easy to build your own AI modeling machine
With its new AI TOP system, Gigabyte is providing specialized hardware components and software to help you build an AI-training PC at home.
Learn more