Live investor webinar
Amplia Therapeutics Limited Investor Briefing 30 July, 11:00 AM AEST
00
days
:
00
hrs
:
00
min
:
00
sec

Why AI Inference Is Rewriting the NAND Demand Supercycle

Citi Research projects agentic AI inference workloads will drive NAND demand supercycle consumption from 2.8% to 9.3% of global output, with each Nvidia Vera Rubin rack alone requiring roughly 1,152 TB of SSD capacity, a structural shift that decouples NAND pricing from consumer electronics cycles entirely.
By John Zadeh -
Enterprise NVMe SSD with NAND demand supercycle data overlays showing 9.3% global NAND share projection
  • Citi Research projects CMX-related NAND demand will scale from 34.6 billion to 115.2 billion 8Gb equivalents, representing a jump from approximately 2.8% to 9.3% of total global NAND output, driven entirely by agentic AI inference workloads.
  • Each Nvidia Vera Rubin NVL72 rack, entering production in the second half of 2026, requires roughly 1,152 TB of TLC NAND dedicated to context memory extension, making GPU cluster deployment counts a direct and trackable NAND demand signal.
  • TrendForce confirms heavy enterprise AI users are consuming up to four times more tokens than prior workloads, and Forrester data shows multi-agent systems consume fifteen times the tokens of a standard chat interaction, meaning NAND demand per deployed cluster steepens as adoption scales.
  • NAND supply is already responding: TrendForce reports producers are reallocating wafer output toward data-centre SSDs, high-capacity QLC enterprise SSDs are described as especially limited, and NAND flash prices are projected to rise approximately 234% across 2026 as a whole.
  • Morgan Stanley projects AI NAND demand reaching 41% of total NAND by 2027, and SanDisk's Q3 2026 results (252% revenue growth, 78.4% non-GAAP gross margin, AI data centres absorbing 70% of high-end production) show infrastructure-grade repricing is already visible at the producer level.

NAND flash has spent years trading as a commodity cyclical, its pricing rhythm set by smartphone refresh rates and PC inventory drawdowns. Wall Street’s NAND models still lean heavily on those consumer demand signals. That framing is about to break.

Citi Research has identified a structurally different demand leg forming beneath the surface. Agentic AI inference workloads, specifically autonomous systems running multi-turn reasoning tasks with million-token context windows, are consuming NAND the way databases consume RAM. Not as passive storage, but as live working memory. That is a category change in how flash gets used, not a seasonal demand spike.

Here is the mechanism behind the claim, the per-rack and aggregate numbers that support it, and the specific indicators that will tell you whether this NAND demand supercycle is materialising as projected or stalling at the prototype stage.

Why AI inference broke the old storage model

Traditional enterprise storage scales with data volume. A company generates more records, more logs, more files; it buys more capacity. The growth function is roughly linear with business activity, and the latency requirement is forgiving.

Agentic AI inference scales with something entirely different: active task state. As AI agents run multi-step, multi-turn reasoning sessions with million-token context windows, the Key-Value cache (the stored keys and values generated by each attention layer at each token position) produced by attention layers expands into territory that GPU memory and DRAM cannot economically contain. The KV-cache is not archival data. It is live working memory that must remain available at low latency across the duration of a task.

The industry’s bottleneck has shifted accordingly. The previous hardware narrative centred on training. Today’s constraint is inference, where KV-cache retention and retrieval dominate resource usage, not raw compute throughput. TrendForce reports that heavy enterprise users are consuming up to 4 times more tokens than prior workloads. SiliconANGLE describes context and KV-cache volumes as “swelling into the petabytes, outpacing what GPU and DRAM memory tiers can absorb.”

The training vs inference split is the underlying reason KV-cache has become the dominant resource constraint in production AI deployments; training optimises for throughput across a fixed dataset, while inference must sustain low-latency memory access across unpredictable, concurrent agent sessions that grow in length over time.

That 4x token consumption figure is not an incremental demand story. It tells you the storage requirement per deployed agent is growing faster than agent headcount, which means the demand curve steepens as adoption scales.

Forrester token consumption analysis quantifies the scaling dynamic precisely: a single AI agent consumes four times as many tokens as a standard chat interaction, and a multi-agent system consumes fifteen times that amount, which means NAND demand per deployed cluster compounds sharply as enterprises move from single-agent pilots to coordinated multi-agent deployments.

  • Traditional enterprise storage: demand driven by data volume; tolerant of higher latency; growth roughly linear with business activity; stores static or infrequently accessed records
  • Agentic AI inference storage: demand driven by active task state and KV-cache size; requires low-latency access throughout each session; growth accelerates with usage intensity and context length; stores live, continuously referenced working memory

What context memory extension architecture actually does

GPU memory is scarce and expensive. High Bandwidth Memory (HBM), the ultra-fast memory stacked directly on GPU packages, delivers extraordinary throughput but ships in limited quantities at premium cost. DRAM faces similar capacity and cost ceilings. Neither tier can absorb petabytes of live KV-cache at the price points that make large-scale inference deployments economically viable.

Context memory extension (CMX) architectures solve this by offloading warm inference states and KV-cache entries from HBM and DRAM down to high-throughput NVMe enterprise SSDs (solid-state drives connected via the NVMe protocol for high-speed data transfer) positioned physically and logically close to GPU clusters. These SSDs are not handling cold archival data. They perform real-time KV-cache offload, context swapping, and low-latency retrieval, functioning as an elastic extension of the AI memory stack.

Peer-reviewed SSD-backed KV cache research published in May 2026 confirms that KV-cache footprints routinely exceed both GPU HBM and CPU DRAM capacity as context windows lengthen, validating the architectural necessity of NVMe SSD offload as a structural rather than provisional design choice.

CapitalSight notes that retaining full KV-cache across high-concurrency inference networks requires petabyte-scale daily storage throughput. Citi Research identifies CMX-related NAND demand as the primary structural driver of new enterprise NAND consumption. Marvell has emphasised that AI workloads are forcing SSD vendors to design GPU-native drives with fundamentally different access patterns: high IOPS (input/output operations per second), low latency, and GPU-initiated reads rather than traditional CPU-attached storage architecture.

The shift to GPU-native SSD design signals that the addressable market for enterprise NAND is no longer defined by server procurement cycles. It is defined by AI infrastructure architecture decisions made at the silicon and rack level.

The AI Inference Memory Stack

Memory tier Example technology Latency profile Role in CMX architecture Cost characteristic
HBM HBM3E Lowest (nanoseconds) Active compute, hottest KV-cache Highest per GB
DRAM DDR5 Low (tens of nanoseconds) Warm KV-cache buffer High per GB
Near-GPU NVMe SSD Enterprise TLC/QLC SSD Moderate (microseconds) CMX offload, context swap, elastic KV store Moderate per GB
Cold object storage HDD / cloud object tier High (milliseconds) Archival, not used in live inference Lowest per GB

Jensen Huang, CES 2026: Nvidia’s CEO characterised the near-GPU storage opportunity as a “completely unserved market” that could become the “largest storage market in the world,” effectively holding the working memory of AI systems.

The Vera Rubin numbers and what they imply at scale

Nvidia’s Vera Rubin platform, announced at CES 2026 with production ramping in the second half of 2026, provides the clearest single data point for how much NAND is now being architected into AI systems at the rack level.

According to Citi Research, each GPU in a Rubin system is allocated around 16 TB of TLC NAND dedicated to CMX operations. Scaled across an NVL72 rack configuration (72 GPUs per rack), that yields a total of roughly 1,152 TB of SSD capacity per deployed system.

Rack-Level Scaling of CMX NAND

Citi Research formalised the demand estimate further. The bank projects that CMX-related NAND consumption begins at 34.6 billion 8Gb equivalents, a share equivalent to roughly 2.8% of total global NAND production, before scaling upward to 115.2 billion 8Gb equivalents, which would represent approximately 9.3% of worldwide output.

Metric Figure Source
NAND per GPU (TLC) ~16 TB Citi Research
NAND per NVL72 rack ~1,152 TB Citi Research
Aggregate demand (100,000 systems) ~115 million TB Citi Research extrapolation
CMX demand, initial estimate 34.6 billion 8Gb eq. (~2.8% of global NAND) Citi Research
CMX demand, growth estimate 115.2 billion 8Gb eq. (~9.3% of global NAND) Citi Research

Moving from 2.8% to 9.3% of global NAND output tied to a single application category within one generation of GPU architecture is not a rounding error. It represents a demand source large enough to shift the market from oversupply to balance without any recovery in consumer NAND demand.

Citi Research frames CMX-related NAND as non-discretionary enterprise infrastructure, meaning system architects cannot reduce SSD allocation without directly degrading model quality, inference latency, and per-token economics.

The broader near-GPU storage trend is also moving toward QLC (quad-level cell) NAND for its density and cost advantages, though Rubin’s CMX specification uses TLC. These are complementary dynamics, not contradictory ones: TLC handles the most latency-sensitive tier while QLC expands capacity at lower cost per gigabyte across the wider fleet.

How this supercycle differs from the smartphone and 5G era

The word “supercycle” has been applied to NAND before. Smartphone adoption, 5G rollouts, and generic cloud build-outs all attracted the label. Each ran into the same failure mode: consumer saturation and inventory overhang caused by discretionary purchasing decisions.

The current AI-driven demand leg differs along three structural axes. First, it is bounded by GPU cluster deployments and data-centre capital expenditure, not by how many phones or PCs ship in a quarter. Second, the storage intensity is non-discretionary: system architects cannot cut KV-cache or context allocation without directly degrading model quality, latency, and throughput. Third, demand is usage-linked. As enterprises deploy more agents handling longer tasks, token volumes and context lengths rise, pulling more live state into SSDs. Demand grows with usage, not just with installed base.

The broader memory chip supercycle context matters here: hyperscaler capex from the four largest U.S. cloud operators is projected at $725 billion in 2026, and AI data centre operators now account for an estimated 70% of total memory shipment volumes, making the data centre the dominant demand centre for the entire industry.

Dimension Smartphone / 5G NAND cycle AI infrastructure NAND cycle
Demand driver Consumer device sales GPU cluster deployments, data-centre capex
Saturation mechanism Replacement cycle slowdown, inventory glut Bounded by compute and power availability
Demand persistence Fades as upgrade cycles lengthen Usage-linked; grows with agent workloads and context length
Key monitoring indicator Smartphone shipment data, carrier capex GPU cluster configs, enterprise AI agent token volumes

TrendForce notes that agentic AI deployments are still nascent, meaning structural NAND demand from large-scale multi-agent systems in finance, healthcare, legal, and industrial sectors is not yet fully reflected in conventional forecasts. Usage-linked demand growth means the NAND demand curve from AI agents steepens as enterprise adoption matures. If you apply a prior supercycle mental model to this cycle, you risk mispricing both the timing and the duration of the demand uplift. The adoption curve here follows enterprise software dynamics, not consumer electronics replacement cycles.

What the supply side tells you about pricing direction

The demand argument is only half the equation. What matters for pricing is how that demand interacts with a concentrated supply base.

The NAND supply industry is structurally concentrated among a handful of producers, which means even marginal demand shifts from a new application category carry outsized pricing implications relative to fragmented commodity markets. Suppliers are already responding. TrendForce observes a polarisation of NAND demand between consumer and client applications on one side and AI-driven infrastructure on the other, with producers reallocating wafer output toward data-centre SSDs. High-capacity QLC enterprise SSDs are “especially limited,” according to TrendForce and InElectronics, because AI infrastructure is pulling those products into near-GPU roles at scale.

Citi Research modelled a scenario in which new enterprise application categories take up available supply and push memory prices upward, independently of any rebound in consumer NAND demand. If suppliers are already reallocating toward enterprise SSDs under a demand profile that Citi estimates at 2.8% of global NAND today, the pricing signal embedded in those allocation decisions may be leading the formal demand curve by several quarters.

The NAND price trajectory already visible in supplier financials supports the structural repricing argument: NAND flash is projected to rise approximately 234% across 2026 as a whole, with major producers recording simultaneous year-on-year earnings growth above 900%, a pattern consistent with industry-wide pricing power rather than individual outperformance.

Observable supply-side indicators worth monitoring:

  • Wafer allocation commentary from NAND producers during earnings calls, specifically any shift toward enterprise or data-centre SSD product lines
  • Enterprise versus client SSD pricing divergence, which would confirm that infrastructure demand is repricing supply away from consumer-grade applications
  • Revenue mix shift toward data-centre SSD products in quarterly filings from major NAND producers
  • Capital expenditure guidance directed at enterprise capacity expansion

TrendForce describes the current dynamic as a “structural expansion in memory demand,” driven by agentic AI workloads shifting industry focus from training to inference.

The indicators worth tracking as this demand leg develops

The structural argument maps onto a specific set of forward indicators that can convert the thesis into an ongoing monitoring framework.

Citi Research’s demand progression, from 34.6 billion to 115.2 billion 8Gb equivalents (approximately 2.8% to 9.3% of global NAND output), provides the concrete benchmark. Actual shipment data and pricing trends from NAND producers can be measured against this range to track whether the demand leg is arriving ahead of, on, or behind schedule.

Indicator category Specific data point Positive signal
GPU cluster deployments Announced NVL72-class system orders Rising deployment count; each system = ~1,152 TB SSD demand
Enterprise AI agent usage Token volume reporting from Salesforce, Microsoft, ServiceNow Sustained growth in concurrent agent workloads and context lengths
SSD pricing divergence Enterprise vs. client SSD ASPs Widening spread indicating infrastructure demand crowding out consumer supply
NAND producer allocation Management commentary on wafer mix, product allocation Shift toward data-centre SSD products at the expense of client/embedded NAND
CMX demand vs. benchmark Actual shipments vs. Citi’s 34.6B-115.2B 8Gb eq. range Shipments tracking at or above the initial estimate

Enterprise AI agent adoption metrics, particularly token usage reporting from major SaaS providers, serve as a leading proxy for KV-cache pressure that precedes the NAND demand signal by one to two quarters. The value of this indicator set is that it decouples the monitoring task from consumer electronics data, where AI-driven NAND demand simply would not appear in the traditional metrics analysts have historically used to call the NAND cycle.

What this structural shift means for how NAND gets priced and valued

The net effect of everything above is a role change for NAND. It is transitioning from a consumer-cycle commodity to a core determinant of AI system throughput, latency, and per-token economics. If that role shift sustains, it carries implications for how NAND producers get valued: as infrastructure suppliers with inelastic demand characteristics rather than discretionary consumer component makers.

Enterprise NAND repricing is already visible at the producer level: SanDisk reported 252% year-over-year revenue growth and a 78.4% non-GAAP gross margin in Q3 2026, with AI data centres absorbing approximately 70% of high-end NAND production and hyperscalers shifting from spot purchasing to multi-year supply contracts.

The degree to which agentic AI adoption scales across enterprise verticals, in finance, healthcare, legal, and industrial sectors, over the next 12 to 24 months is the primary variable determining whether Citi’s 9.3% global NAND share estimate proves conservative or premature. Morgan Stanley projects AI NAND demand reaching 41% of total NAND by 2027, though this figure has not been independently confirmed and should be treated as one projection among several.

Jensen Huang, CES 2026: The near-GPU storage market is a “completely unserved market” that could become the “largest storage market in the world.”

If the infrastructure-grade demand argument holds, NAND pricing cycles will increasingly decouple from consumer electronics seasonality. The traditional playbook for timing NAND exposure may need to be recalibrated around enterprise AI capex calendars instead.

The recalibration is not a forecast. It is an architectural reality already embedded in systems shipping in the second half of 2026. How far it extends depends on variables you can now track with specificity.

This article is for informational purposes only and should not be considered financial advice. Investors should conduct their own research and consult with financial professionals before making investment decisions. Financial projections referenced in this analysis are subject to market conditions and various risk factors. Past performance does not guarantee future results.

Frequently Asked Questions

What is a NAND demand supercycle and how is AI driving the current one?

A NAND demand supercycle is a sustained period of above-trend NAND flash consumption that structurally reprices the market. The current cycle is driven by agentic AI inference workloads, where KV-cache memory requirements from million-token context windows are consuming enterprise NVMe SSDs as live working memory rather than passive storage.

What is KV-cache and why does it matter for NAND storage demand?

KV-cache (Key-Value cache) is the live working memory generated by AI attention layers during inference, storing keys and values at each token position across a reasoning session. As context windows extend into the millions of tokens, KV-cache volumes exceed GPU HBM and DRAM capacity, forcing offload to high-throughput NVMe SSDs and creating direct structural demand for enterprise NAND.

How much NAND does an Nvidia Vera Rubin NVL72 rack require?

According to Citi Research, each GPU in a Vera Rubin system is allocated approximately 16 TB of TLC NAND for context memory extension operations, scaling to roughly 1,152 TB of SSD capacity per NVL72 rack across its 72 GPUs.

How does AI-driven NAND demand differ from the smartphone and 5G supercycles?

Unlike smartphone and 5G cycles, which faded as consumer upgrade rates slowed and inventory built up, AI infrastructure NAND demand is usage-linked and non-discretionary: system architects cannot cut KV-cache allocation without degrading model quality and inference latency, and demand compounds as enterprises scale from single-agent to multi-agent deployments.

What indicators should investors monitor to track whether the AI NAND supercycle is materialising?

The most actionable indicators are NVL72-class GPU cluster deployment volumes (each system adds roughly 1,152 TB of SSD demand), enterprise versus client SSD pricing divergence, wafer allocation commentary from NAND producers shifting toward data-centre products, and token volume reporting from major SaaS providers such as Salesforce, Microsoft, and ServiceNow as a leading proxy for KV-cache pressure.

John Zadeh
By John Zadeh
Founder & CEO
John Zadeh is an investor and media entrepreneur with over a decade in financial markets. As Founder and CEO of StockWire X and Discovery Alert, Australia's largest mining news site, he's built an independent financial publishing group serving investors across the globe.
Learn More

Breaking ASX Alerts Direct to Your Inbox

Join +20,000 subscribers receiving alerts.

Join thousands of investors who rely on StockWire X for timely, accurate market intelligence.

About the Publisher