How Much Progress Has There Been in NVIDIA Datacenter GPUs?

2026-01-27

AI Summary

This study systematically evaluates the technological evolution of NVIDIA data center GPUs since the mid-2000s and its implications for artificial intelligence advancement and export control policies. By constructing a multidimensional historical dataset encompassing FP16, FP32, and FP64 computational throughput, memory bandwidth, power consumption, and pricing, the authors employ technical metric modeling and trend-fitting methods to quantitatively characterize, for the first time, the growth patterns of key performance indicators. The analysis reveals that FP16 and FP32 compute performance doubles approximately every 1.44–1.69 years, while memory bandwidth doubles every 3.32–3.53 years. Furthermore, under full implementation of U.S. export controls, the performance gap between U.S. and Chinese AI chips would narrow dramatically from 23.6× to 3.54×, underscoring the profound impact of policy interventions on the global AI compute landscape.

Technology Category

• Humans and AI: Other Foundations of Human Computation & AI
• Machine Learning: Hardware-aware ML
• Philosophy and Ethics of AI: Bias, Fairness & Equity

Application Category

• Economics, Online Markets and Human Computation: Economic ramifications for generative AI infrastructure and applications
• Security and Privacy: Data transparency and provenance
• Graph Algorithms and Modeling for the Web: Foundation models and LLMs for Web-related graphs

Abstract

Graphics Processing Units (GPUs) are the state-of-the-art architecture for essential tasks, ranging from rendering 2D/3D graphics to accelerating workloads in supercomputing centers and, of course, Artificial Intelligence (AI). As GPUs continue improving to satisfy ever-increasing performance demands, analyzing past and current progress becomes paramount in determining future constraints on scientific research. This is particularly compelling in the AI domain, where rapid technological advancements and fierce global competition have led the United States to recently implement export control regulations limiting international access to advanced AI chips. For this reason, this paper studies technical progress in NVIDIA datacenter GPUs released from the mid-2000s until today. Specifically, we compile a comprehensive dataset of datacenter NVIDIA GPUs comprising several features, ranging from computational performance to release price. Then, we examine trends in main GPU features and estimate progress indicators for per-memory bandwidth, per-dollar, and per-watt increase rates. Our main results identify doubling times of 1.44 and 1.69 years for FP16 and FP32 operations (without accounting for sparsity benefits), while FP64 doubling times range from 2.06 to 3.79 years. Off-chip memory size and bandwidth grew at slower rates than computing performance, doubling every 3.32 to 3.53 years. The release prices of datacenter GPUs have roughly doubled every 5.1 years, while their power consumption has approximately doubled every 16 years. Finally, we quantify the potential implications of current U.S. export control regulations in terms of the potential performance gaps that would result if implementation were assumed to be complete and successful. We find that recently proposed changes to export controls would shrink the potential performance gap from 23.6x to 3.54x.

Problem

• GPU progress
• NVIDIA datacenter GPUs
• export control
• AI hardware
• performance gap

Innovation

• GPU performance trends
• technological progress metrics
• AI hardware export controls
• computational efficiency analysis
• NVIDIA datacenter GPUs