Source-linked AI summary
Is 3D chip technology the next growth engine for performance improvement?
Philip Emma, Eren Kurshan
TL;DR
The paper examines how 3D integration can extend scaling while introducing design constraints, analyzes cache and stack structures, and finds that careful organization can reduce bus dislocations by six orders of magnitude.
Problem
3D scaling raises unresolved questions about optimal layer counts and the limits of stacking as conventional 2D scaling slows.
Method
The paper analyzes 3D cache placement and stack geometry to compare vertical interconnect organization and layer-versus-footprint expansion.
Results
Careful cache-hierarchy planning can reduce x–y bus dislocations by six orders of magnitude in an example, depending on cache geometry and line size.
Takeaways & Limitations
3D systems can support nearly vertical, wide buses that facilitate rapid, reasonably low-power swapping of entire software contexts.
Takeaways & Limitations
Power delivery and heat removal are major limitations because denser 3D integration increases power density and thermal resistance.
Abstract
from arXiv · showhide
The semiconductor industry is reaching a fascinating confluence in several evolutionary trends that will likely lead to a number of revolutionary changes in how computer systems are designed, implemented, scaled, and used. Since Moores Law, which has driven the evolution in systems for the last several decades, is imminently approaching real and severe limitations, the ability to create three-dimensional,3D, device stacks appears promising as a way to continue to integrate more devices into a chip.While on the one hand, this nascent ability to make 3D technology can be interpreted as merely an extension of Moores Law, on the other hand, the fact that systems can now be integrated across multiple planes poses some novel opportunities, as well as serious challenges and questions. In this paper, we explore these various challenges and opportunities and discuss structures and systems that are likely to be facilitated by 3D technology. We also describe the ways in which these systems are likely to change. Since 3D technology offers some different value propositions, we expect that some of the most important ways in which 3D technology will likely impact our approach to future systems design, implementation, and usage are not yet obvious to most system designers, and we outline several of them.
Unique advantages and challenges of 3D systems · Received January 22, 2008; accepted for publication
3D systems promise higher volumetric density, shorter and faster interconnects, and greater connectivity, but their practicality depends on overcoming manufacturing, stacking, power-delivery, and thermal challenges. These constraints shape optimal layer count, geometry, and future system architectures while potentially enabling applications and software innovations beyond current systems.
- Unique advantages and challenges of 3D systems: 3D structures improve volumetric density, shorten connections for faster and more power-efficient communication, and increase interconnectivity through additional lateral and vertical neighbors.These benefits create opportunities to integrate components more densely while improving communication efficiency.
- Unique advantages and challenges of 3D systems: Careful cache-bit placement can reduce x–y dislocations in stacked-cache bus infrastructure by six orders of magnitude, depending on line size and cache geometry.The resulting vertical buses can be designed nearly purely vertical and wide for many 3D cache configurations.
- Unique advantages and challenges of 3D systems: 3D fabrication requires new building, assembly, and test processes because individually testable layers must achieve adequate assembly-stage coverage and final yield.Wafer-to-wafer bonding is more practical than chip-to-wafer or chip-to-chip bonding but requires greater redundancy for high-yielding wafers.
- Unique advantages and challenges of 3D systems: The optimal stack balances adding layers against enlarging the footprint: adding a layer is preferable when n < x/2d, otherwise increasing the footprint is preferable.The tradeoff follows from comparing the usable circuit area gained by one additional layer with that gained by expanding each layer laterally.
- Unique advantages and challenges of 3D systems: Power delivery and heat removal become immediate limits because denser 3D integration raises power density, while taller stacks require more power vias and create harder thermal gradients.Layer thickness also affects TSV impedance and stack height, making thin-layer fabrication an electrical as well as processing and yield concern.
- Unique advantages and challenges of 3D systems: Thermal vias and redundant power/ground vias improve stack conductivity, but aggressive high-power-density stacking may still require 3D-specific cooling technologies.Traditional peripheral cooling is challenged by increased packaging density and thermal gradients in vertically integrated stacks.
- Unique advantages and challenges of 3D systems: Future 3D systems could combine carriers with arrays of stacks into socketable 3½-dimensional entities and remove memory-bandwidth bottlenecks that constrain software and microarchitecture.The authors anticipate new applications and substantial innovation as 3D integration changes system organization beyond the scale of current systems.