The race to develop faster and more efficient computing systems for artificial intelligence (AI) applications is heating up, and optical interconnects are emerging as a game-changing technology. One company, Lightmatter, is leading the charge with its innovative Passage optical interposer, a silicon chip that promises to revolutionize how processors communicate with each other and potentially decrease the energy consumption of AI data centers by up to 95%.
The Need for Speed: AI’s Computational Demands
As AI continues to advance, the computational demands on data centers are becoming increasingly challenging. Traditional electrical connections between processors are reaching their limits, hindering further progress in AI development. According to Nick Harris, CEO of Lightmatter, “Progress in computing from now on is going to come from linking multiple chips together.” (Source)
To meet the insatiable appetite for computing power required by AI workloads, companies like Lightmatter are turning to photonic interconnects, which use light instead of electricity to transmit data. By harnessing the speed of light, these interconnects can significantly reduce latency and energy consumption, overcoming the limitations of traditional electrical connections.
The Passage Optical Interposer: A Breakthrough in Processor Connectivity
Lightmatter’s Passage optical interposer is a groundbreaking technology that brings photonic interconnects directly onto the processor package. Unlike other approaches that place optical I/O chiplets beside the main processor die, Passage integrates the optical interconnects underneath the processor, enabling direct connections between any chiplet within the processor.
This innovative design eliminates the need for electrical connections between chiplets, reducing latency and energy consumption. According to Lightmatter, Passage can enable a data center to use between one-sixth and one-twentieth as much energy as traditional electrical interconnects, with efficiency increasing as the data center scales up. (Source)
The Rise of Optical Interconnects and the Future of AI
The adoption of optical interconnects in data centers is being driven by the growing demand for accelerated computing, particularly in the field of AI. According to TechInsights, an industry analyst firm, by 2029, a third of servers shipped will be accelerated, featuring CPUs paired with GPUs or other AI-accelerating ICs. This trend has attracted significant investment in photonic interconnect technologies, with Lightmatter alone raising $850 million and achieving a multi-unicorn valuation of $4.4 billion. (Source)
As the demand for AI continues to soar, optical interconnects like Lightmatter’s Passage are poised to play a critical role in enabling faster and more energy-efficient computing systems, driving further advancements in this rapidly evolving field.
For more information, refer to the original article from IEEE Spectrum: https://spectrum.ieee.org/optical-interposers