ST Silicon Photonics and BiCMOS Technologies for AI Optical Interconnects
Artificial intelligence (AI) is transforming industries, driving innovation and efficiency, but its sustainability is crucial for long-term benefits.
Sustainable AI growth faces several challenges, including energy consumption. AI large language models (LLMs) require significant computational power, leading to high energy consumption.
Recent comments from industry executives anticipate a factor of 100 times more computes required for the next generation of LLM training, while the energy needed to train a leading model is multiplied by 10 every two years.
The processing of LLMs is typically partitioned over different accelerators to optimize performance, driving key parameter needs.
Author's summary: AI growth needs sustainable solutions.