🤖 AI Summary
The breakdown of Moore’s Law and Dennard scaling has rendered traditional manual architecture design inadequate for navigating increasingly complex design spaces and overcoming performance bottlenecks. To address this challenge, this work proposes the first end-to-end automated architecture discovery system—dubbed a “creative factory”—which leverages a multi-level simulation-based evaluation pipeline to generate and assess thousands of candidate architectures weekly. By integrating real-world deployment telemetry into a closed-loop feedback learning mechanism, the approach pioneers the integration of large-scale automated exploration and data-driven optimization into computer architecture design. This paradigm fundamentally overcomes the inherent limitations of human teams in exploration breadth and iteration speed, compressing design cycles from tens of months to mere weeks while substantially improving performance-efficiency trade-offs.
📝 Abstract
The end of Moore's Law and Dennard scaling has fundamentally changed the economics of computer architecture. With transistor scaling delivering diminishing returns, architectural innovation is now the primary - and perhaps only - remaining lever for performance improvement. However, we argue that human-driven architecture research is fundamentally ill-suited for this new era. The architectural design space is vast (effectively infinite for practical purposes), yet human teams explore perhaps 50-100 designs per generation, sampling less than 0.001% of possibilities. This approach worked during the abundance era when Moore's Law provided a rising tide that lifted all designs. In the current scarcity paradigm, where every architecture must deliver 2X performance improvements using essentially the same transistor budget, systematic exploration becomes critical. We propose a concrete alternative: automated idea factories that generate and evaluate thousands of candidate architectures weekly through multi-tiered evaluation pipelines, learning from deployed telemetry data in a continuous feedback loop. Early results suggest that such systems can compress architectural design cycles from double-digit months to single-digit weeks by exploring orders of magnitude more candidates than any human team, and do it much faster. We predict that within 2 years, purely human-driven architecture research will be as obsolete as human chess players competing against engines.