Saturday, July 4, 2026Vol. III · No. 185Subscribe
The Mining, Energy & Technology Wire
Technology · Analysis

The $750 Billion Chip Crunch

Memory makers now hold more power than GPU designers. As HBM shortages reshape the AI hardware race, governments are texting CEOs to secure data center deals.

The $750 Billion Chip Crunch
PhotographMemory makers now hold more power than GPU designers. As HBM shortages reshape the AI hardware race, governments are texting CEOs to secure data center deals.

DRAM prices will rise between 50% and 55% this quarter versus the fourth quarter of 2025 — an increase TrendForce analyst Tom Hsu called "unprecedented." The culprit is not a supply shock or a trade war. It is high-bandwidth memory, the specialized chips stacked atop AI accelerators, and data centers now consume an estimated 70% of all memory chips produced worldwide.

HBM is sold out through 2026, with allocations for 2027 already being negotiated. The shortage has flipped the power structure of the AI hardware stack. Nvidia still designs the processors everyone wants. But the real power in AI infrastructure is shifting to the memory makers: Samsung, SK Hynix, and Micron.

A single Nvidia B300 GPU requires eight HBM chips, each containing 12 individual DRAM dies — 96 dies per GPU, or 768 dies for a fully configured DGX B300 system with eight GPUs. When Micron can only meet two-thirds of the medium-term memory requirements for some customers, according to its own executives, the constraint is no longer theoretical.

Who Wins When Memory Becomes the Moat?

HBM commands significantly higher margins than standard DRAM modules used in consumer devices, and Samsung, SK Hynix, and Micron have all been aggressively converting production lines to HBM, as the revenue per wafer for HBM is estimated to be three to five times higher than conventional DDR5. The economics are brutal for everyone else. A single silicon wafer provides 3x as much commodity DRAM as HBM, and fab processing time for HBM is significantly longer too, making the supply problem worse — producing more HBM equates to fewer total memory chips produced.

The three major memory manufacturers are enjoying significantly higher margins as DRAM prices surge, and SK Hynix, which has been the leading supplier of HBM chips, has seen its revenue from AI-related memory products more than triple since 2024.

In October, SK Hynix said it had secured demand for its entire 2026 RAM production capacity. Samsung and Micron are racing to catch up, but Samsung Electronics has struggled to meet Nvidia's qualification standards for its 12-layer HBM3E chips due to yield and performance issues, relegating the world's largest memory maker to a tertiary position.

The ripple effects extend far beyond AI labs. Your next laptop, smartphone, or even refrigerator is going to cost more — and you can thank AI for that, as the AI boom has triggered what insiders are calling "RAMageddon."

Memory now accounts for about 20% of the hardware costs of a laptop, up from between 10% and 18% in the first half of 2025.

Tesla CEO Elon Musk stated in late January 2026 that the company faces a "chip wall," describing the constraint as forcing a stark choice to "hit the chip wall or make a fab."

Can $750 Billion Buy Enough Compute?

The money flooding into AI infrastructure has reached a scale that defies easy comparison. The capital expenditure of the 14 largest publicly owned data center operators globally is seen close to $750 billion this year against a little less than $450 billion last year.

JPMorgan raised its estimate for global AI-related capital expenditures through 2030 to $5.5 trillion, up from $5.1 trillion, driven by greater capacity expansion and increased debt financing.

Goldman Sachs Research's baseline model implies $765 billion in annual AI CapEx in 2026, growing to $1.6 trillion in annual CapEx in 2031.

At Nvidia's GTC conference in March, CEO Jensen Huang said the company doubled its demand forecast within the next year: "I see through 2027 at least $1 trillion. In fact, we are going to be short. I am certain computing demand will be much higher than that."

The capital is not evenly distributed. Microsoft expects to invest roughly $190 billion in capital expenditures in calendar year 2026, a 61% increase from the previous year.

The four largest hyperscalers — Amazon, Google, Microsoft, Meta — are expected to spend more than $350 billion on capex in 2025, and including other tech players pushes the total toward an estimated $0.5 trillion in 2025.

But money alone does not solve the bottleneck. Power availability — not capital — is the primary constraint on data center development, and electrical grid interconnections are often taking up to four years.

The Department of Energy already projects data centers will account for up to 12% of U.S. electrical demand by 2028, and the grid is not ready.

Chevron and Microsoft signed a 20-year agreement to supply dedicated power for a planned data center campus near Pecos, Texas, one of the largest pairings of compute infrastructure and on-site generation in the US.

Why Are Presidents Texting Tech CEOs?

The geopolitical stakes have turned AI infrastructure into a contest of personal diplomacy. French President Emmanuel Macron and Indian Prime Minister Narendra Modi have stepped up personal outreach to major tech CEOs, as France and India are trying to secure AI data centers, cloud infrastructure and chip investment, and the pair have ramped up moves to court leaders of the world's biggest tech companies this year.

In May, SoftBank announced plans to build 3.1 GW of AI data centers in France by 2031, as part of a 75-billion-euro program to roll out 5 GW of AI data center capacity, after Macron requested a meeting with SoftBank's Son to persuade him to commit to the project two months earlier, and the two exchanged texts as they hashed out the details.

Modi met with Amazon's CEO Andy Jassy last Thursday, and welcomed the U.S. tech giant's "record $48 billion investment" in the country, of which $21 billion will be for AI and cloud infrastructure.

At the G7 conference in June, which France was hosting, Macron approached tech bosses to join a working lunch with world leaders, including U.S. President Donald Trump, and CEOs including OpenAI's Sam Altman, Anthropic's Dario Amodei, Google DeepMind's Demis Hassabis all took part.

India secured Microsoft's largest investment in Asia to help build the sovereign capabilities needed for India's AI-first future, while Google announced an investment of $15 billion in India to build the firm's largest AI hub in the world outside of the U.S.

The competition is not just between nations but between business models. The AI accelerator market is transitioning from Nvidia monopoly to a three-tier competitive structure: Nvidia retains 60–75% through 2028, AMD reaches 10–15% as the credible merchant silicon alternative, and custom silicon captures 15–25% concentrated in cloud-locked inference.

H100 SXM5 spot prices fell from $25,000-35,000 in 2023 to $18,000-25,000 by early 2026, and cloud H100 on-demand rates are at multi-year lows.

TSMC's Fab 21 Phase 1 in Arizona is now operational and producing advanced chips for key customers including Apple and Nvidia, and the facility is manufacturing chips for Nvidia's Blackwell AI processors, marking the first time TSMC has produced cutting-edge AI silicon outside of Taiwan.

In March 2025, TSMC announced an additional investment of $100 billion to support three more advanced fabs, two packaging facilities, and a dedicated R&D center, bringing the total project investment to $165 billion.

What Changed This Week

The memory shortage crossed from constraint to crisis. DRAM prices are projected to rise more than 70% in 2026, and trends of shortage and price surges are expected to persist.

Virginia lawmakers approved legislation for a first-of-its-kind tax on data center electricity consumption, establishing a consumption tax of $0.011 per kilowatt-hour on all electricity consumed by data centers beginning July 1, 2026, with legislative budget documents estimating the tax will generate $600 million annually for Virginia's general fund over the next two years. The infrastructure buildout that was supposed to democratize AI is instead concentrating power among the few companies that locked in memory supply early.

What to Watch

TSMC plans to begin moving chipmaking equipment into its Arizona Fab 21 Phase 2 facility in Q3 2026 (July through September), with high-volume 3nm production targeted for 2027.

Micron is currently building two big fabs in Boise, Idaho, that will start producing memory in 2027 and 2028, and is also going to break ground on a fab in Clay, New York, that is expected to come online in 2030.

Due to long lead times, new HBM capacity is not expected to significantly alleviate the shortage before 2026-2027. The question is whether AI demand can sustain its current trajectory long enough for supply to catch up — or whether the memory wall forces a reckoning first.

Original reporting and analysis by the Stake & Paper editorial team. See linked sources within the article.

Share this story

More from Stake & Paper

Was this article helpful?

ClaimWatch

Mining claims intelligence — from query to report, in minutes.

Every unpatented mining claim across all twelve BLM states. Leadfile audits, due diligence, site selection, regional prospecting, entity investigations, and AOI monitoring — delivered as complete report packages.

4.4M+
Claims Tracked
12
BLM States
7
Report Types
Request a Sample Report
Stake & Paper AM

One morning brief. The whole energy sector.

Original analysis, the day's most important wire stories, and market data — delivered before your first cup of coffee. Free.