Categorie: News

A single family of AI GPUs will require as much memory as 10% of the global smartphone market

The unstoppable rise of artificial intelligence is starting to take its toll, and it’s not just about energy consumption, but a real hardware resource crisis that risks reshaping the consumer electronics economy.

According to a recent note from KeyBanc analysts, the architectural changes implemented by NVIDIA in its new Vera Rubin series GPUs are expected to consume a significant portion of global memory resources this year.

In a market already characterized by limited supply, this memory ‘hunger’ from the AI chip giant is creating a cascading effect that will hit smartphone manufacturers hard, including giants like Apple and Samsung, forcing the market toward inevitable price increases.

NVIDIA Vera Rubin AI GPUs won’t settle for memory that ‘advances’

Credits: NVIDIA

At the center of this market turmoil is a specific technical choice adopted by NVIDIA. Processing AI queries requires creating an enormous temporary memory register for building context, technically known as “KV Cache“.

Until now, in NVIDIA systems, this register was stored inside the HBM memory modules. However, with the Vera Rubin architecture, the company has introduced a new solution called Inference Memory Context Storage (ICMS), which serves as a memory resource dedicated exclusively to that purpose.

This novelty, though technically brilliant, has massive consequences on the supply chain. Estimates indicate that NVIDIA could integrate about 16 TB of NAND memory per GPU in a rack, which translates into a staggering total of 1,152 TB in a single NVL72 configuration.

KeyBanc provided a concerning context to these numbers: the new Vera CPU uses 1.5 TB of memory, a significant jump from the 512 GB of the previous Grace architecture. This implies that NVIDIA will require about 20 billion Gb of memory this year. To put this figure in perspective, such consumption equals the memory needed to produce between 100 and 150 million smartphones, i.e., just under 10% of the entire global mobile phone market.

Apple and Samsung in the crosshairs

The repercussions of this massive allocation of resources toward AI are also putting pressure on tech giants that traditionally dominate supply chains.

Apple, for example, is facing a challenging situation. According to Morgan Stanley’s assessments, although the Cupertino company has secured access to NAND resources sufficient until Q1 2026, the supplier KIOXIA is expected to raise prices once the new long-term supply agreement is signed.

Even more critical is the situation regarding DRAM memory, which constitutes a significant bottleneck. Although Apple had previously signed very favorable long-term contracts, current market conditions suggest the company will secure access to DRAM resources until early 2026 only by accepting a sequential price increase exceeding 50%.

Paradoxically, not even Samsung, one of the world’s leading memory manufacturers, is immune to this price-driven demand destruction dynamic.

Internal reports suggest tensions between the divisions of the Korean conglomerate: the DS division, which makes memory chips, has agreed to supply components to the MX mobile division only in exchange for price increases between 60% and 70%.

This internal inflation has pushed Samsung to plan a price increase for the upcoming Galaxy S26 series, estimated at between 30 and 60 dollars in selected regions, including South Korea.

Luca Zaninello

Appassionato del mondo della telefonia da sempre, da oltre un decennio si occupa di provare con mano i prodotti e di raccontare le sue esperienze al pubblico del web. Fotografo amatoriale, ha un occhio di riguardo per i cameraphone più esagerati.

Recent Posts

Google aims to go head-to-head with WHOOP, Stephen Curry previews the new Fitbit

Google is preparing to introduce a brand-new device for its wearables lineup, entering direct competition…

8 hours ago

vivo X300 Ultra: less battery in Europe, but you won’t be disappointed

Recently Vivo announced its new Camera Phone for the Chinese market, with a major novelty…

9 hours ago

Will Google block Android downgrades with the next Pixel 10 update?

Google seems intent on tightening protection measures related to software on its newer smartphones. According…

9 hours ago

Review Realme Buds Air8: the new benchmark at 50 euros

The market for TWS headphones is now saturated, with fierce competition among brands to offer…

9 hours ago

Nothing beyond the boundaries of smartphones: it will target AI glasses

The company founded by Carl Pei aims to expand its product ecosystem well beyond smartphones.…

9 hours ago

Pixel 11 Pro in render images: the winning design doesn’t change (but can be improved)

A few days after the renders dedicated to the standard model, we are back to…

10 hours ago