Alphabet shares saw a notable 3% uptick on Monday, following reports from The Information detailing the tech giant’s development of a new server chip, internally codenamed “Frozen v2.” This cutting-edge silicon is engineered to significantly enhance the efficiency of running Google’s sophisticated Gemini AI models.
The innovation lies in permanently integrating key architectural components of the Gemini models directly into the chip’s hardware. This approach aims to drastically reduce the computational overhead and data movement typically required for AI systems to process and respond to queries, according to the publication.
Engineers at Google project that Frozen v2 could deliver an astonishing six to ten times more tokens per unit of power compared to the company’s current generation of Tensor Processing Units (TPUs), which are custom-designed for AI workloads. Importantly, Frozen v2 is envisioned as a specialized extension of Google’s custom-chip portfolio, rather than a direct replacement for its versatile TPUs.
The deployment of this new chip is reportedly targeted for 2028. This ambitious timeline is driven by a critical internal compute shortage that has reportedly strained resources and even led Google Cloud to decline outside business opportunities. This underscores the immense demand for AI processing power and Google’s strategic imperative to secure sufficient capacity.
The financial implications of this compute demand are significant. Just last month, Google reportedly committed to paying SpaceX close to $1 billion per month to bolster its enterprise compute capabilities and meet its growing commitments.
However, this specialized hardware approach comes with a trade-off: reduced flexibility. The Information suggests that the chip’s efficacy would be tied to specific Gemini model architectures. Consequently, if Google shifts its underlying AI architecture in the future, the full benefits of Frozen v2 might be diminished. The company is reportedly viewing Frozen v2 initially as a pilot program, with no immediate plans for mass production on the scale of its TPUs.
Alphabet has not yet responded to requests for comment on these developments.
Alphabet stock chart.
Original article, Author: Tobias. If you wish to reprint this article, please indicate the source:https://aicnbc.com/23881.html
